• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Fang, Juan (Fang, Juan.) (Scholars:方娟) | Sun, Hao (Sun, Hao.) | Zhou, Li-Fu (Zhou, Li-Fu.) | Ren, Xing-Tian (Ren, Xing-Tian.) | Cai, Min (Cai, Min.)

Indexed by:

CPCI-S

Abstract:

MapReduce is an effective programming model for analyzing large-scale data. Hadoop-a distributed processing system is widely used nowadays. Improving the task parallelism can be a key point to improve the MapReduce performance in Hadoop. In this paper, we address the problem in two ways. On the one hand we can run the tasks with some dynamic configurations. On the other hand, considering of the difference of tasktracker we use mathematics method to predict the cups' utilization of tasktracker to assign the task. Experimental results on both ways show we can improve the performance in Hadoop by improving the task parallelism.

Keyword:

big data prediction high performance dynamic

Author Community:

  • [ 1 ] [Fang, Juan]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 2 ] [Sun, Hao]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 3 ] [Zhou, Li-Fu]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 4 ] [Ren, Xing-Tian]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 5 ] [Cai, Min]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China

Reprint Author's Address:

  • 方娟

    [Fang, Juan]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China

Show more details

Related Keywords:

Source :

PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND INFORMATION SYSTEMS

ISSN: 2352-538X

Year: 2016

Volume: 52

Page: 275-278

Language: English

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 4

Online/Total:310/10642296
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.