• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Fang, Juan (Fang, Juan.) (Scholars:方娟) | Wang, Mengxuan (Wang, Mengxuan.) | Sun, Hao (Sun, Hao.)

Indexed by:

EI Scopus

Abstract:

With the arrival of big data era, distributed computing framework Hadoop has become the main solution to deal with big data now. People usually promote the performance of distributed computing by adding new computing nodes to cluster. With the expansion of the scale of the cluster, it produces a large amount of power consumption because of lack of reasonable management strategy. So how to make full use of computing resources in the cluster to improve the performance of the whole system and reduce the power consumption has become the main research direction of scholars and industrial circles. For the above, in order to make best use of computing resources and reduce the power consumption, this paper firstly proposes to optimize a reasonable configuration of the parameters provided by Hadoop. Comparing with the default configuration of Hadoop. It shows we can get better performance by parameter tuning. This paper proposes a task scheduling mechanism based on memory usage prediction. In this task schedule, it predicts the future use status of memory in the computing nodes by analyzing the use status before. The task scheduling mechanism can reduce the memory pressure by reducing the allocation of tasks when the computing node is under memory pressure. The task scheduling mechanism can be more flexible by setting the threshold of memory usage. This mechanism based on predicting memory usage can improve the performance of the system by making full use of the computing resources. © Springer Nature Singapore Pte Ltd. 2018.

Keyword:

Multitasking Green computing Forecasting Mobile ad hoc networks Cluster computing Big data Electric power utilization Sensor networks Industrial research

Author Community:

  • [ 1 ] [Fang, Juan]Beijing University of Technology, 100 Ping Le Yuan, Chaoyang District, Beijing, China
  • [ 2 ] [Wang, Mengxuan]Beijing University of Technology, 100 Ping Le Yuan, Chaoyang District, Beijing, China
  • [ 3 ] [Sun, Hao]Beijing University of Technology, 100 Ping Le Yuan, Chaoyang District, Beijing, China

Reprint Author's Address:

  • 方娟

    [fang, juan]beijing university of technology, 100 ping le yuan, chaoyang district, beijing, china

Show more details

Related Keywords:

Related Article:

Source :

ISSN: 1865-0929

Year: 2018

Volume: 747

Page: 227-236

Language: English

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 6

Affiliated Colleges:

Online/Total:1253/10841954
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.