• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Guo, Xiao-Li (Guo, Xiao-Li.) | Chen, Bo (Chen, Bo.)

Indexed by:

CPCI-S EI Scopus

Abstract:

ETL is a key link in the construction of data warehouse. On the base of analyzing the mainstream ETL tool Datastage, the data extraction, transformation and loading, proposes a ETL framework based on data processing, and the realization method and steps are discussed in detail. The framework uses HIVE as a data processing station, improve the operating efficiency of the file; data task according to the E, T and L three parts and hierarchical partitioning, conversion of data users to better grasp the process; development data using the configuration file of the task, the development personnel free out from the heavy code, will to shift the focus of the work to the data logical task, which has greatly improved the efficiency of development personnel data processing.

Keyword:

data conversion ETL framework Data processing data extraction data loading

Author Community:

  • [ 1 ] [Guo, Xiao-Li]China Univ Min & Technol Beijing, Sch Mech Elect & Informat Engn, Beijing, Peoples R China
  • [ 2 ] [Chen, Bo]Beijing Univ Technol, Sch Software Engn, Beijing, Peoples R China

Reprint Author's Address:

  • [Guo, Xiao-Li]China Univ Min & Technol Beijing, Sch Mech Elect & Informat Engn, Beijing, Peoples R China

Show more details

Related Keywords:

Source :

MODERN TECHNOLOGIES IN MATERIALS, MECHANICS AND INTELLIGENT SYSTEMS

ISSN: 1022-6680

Year: 2014

Volume: 1049

Page: 1966-,

Language: English

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 10

Online/Total:500/10577964
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.