• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Hou, Ying (Hou, Ying.) | Liang, Yi (Liang, Yi.) | Su, Chao (Su, Chao.)

Indexed by:

CPCI-S

Abstract:

Streaming data processing has become a hot topic in the big data research. To ensure the timeliness of data processing, it is important to explore the performance-sensitive components in the streaming data processing platform, which can contribute to the more efficient performance optimization. In this paper, we describe the data processing model in the Spark Streaming, the process can be divided into multiple phases. We propose a simple yet useful method to explore performance-sensitive component components among these phases. Experimental results show that the proposed method is suitable for a wide range of workloads. At last, we demonstrate a detail example of the application of this method on the typical Spark Streaming workload Word count and prove its practicability.

Keyword:

performance-sensitive components spark streaming big data

Author Community:

  • [ 1 ] [Hou, Ying]Sch Beijing Univ Technol, Beijing 100124, Peoples R China
  • [ 2 ] [Liang, Yi]Sch Beijing Univ Technol, Beijing 100124, Peoples R China
  • [ 3 ] [Su, Chao]Sch Beijing Univ Technol, Beijing 100124, Peoples R China

Reprint Author's Address:

  • [Hou, Ying]Sch Beijing Univ Technol, Beijing 100124, Peoples R China

Show more details

Related Keywords:

Related Article:

Source :

PROCEEDINGS OF THE ADVANCES IN MATERIALS, MACHINERY, ELECTRICAL ENGINEERING (AMMEE 2017)

ISSN: 2352-5401

Year: 2017

Volume: 114

Page: 390-394

Language: English

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 8

Affiliated Colleges:

Online/Total:553/10555160
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.