• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Liang, Yi (Liang, Yi.) | Zeng, Shaokang (Zeng, Shaokang.) | Liang, Yande (Liang, Yande.) | Chen, Kaizhong (Chen, Kaizhong.)

Indexed by:

EI Scopus

Abstract:

Collaborative Filtering (CF) is an important building block of recommendation systems. Alternating Least Squares (ALS) is the most popular algorithm used in CF models to calculate the latent factor matrix factorization. Parallel ALS on Hadoop is widely used in the era of big data. However, existing work on the computational efficiency of parallel ALS on Hadoop have two defects. One is the imbalance of data distribution, the other is lacking the fine-grained parallel processing on the rating data. Aiming on these issues, we propose an integrated optimized solution. The solution first optimizes the rating data partition with the consideration of both the number of involved data records and the partitioned data size. Then, the multithread-based fine-grained parallelism is introduced to process rating data records within a map task concurrently. Experimental results demonstrate that our solution can reduce the overall runtime of Hadoop ALS by 82.17% by maximum. © Springer Nature Switzerland AG 2020.

Keyword:

Data handling Computational efficiency Factorization Distributed database systems Collaborative filtering Benchmarking

Author Community:

  • [ 1 ] [Liang, Yi]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 2 ] [Zeng, Shaokang]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 3 ] [Liang, Yande]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 4 ] [Chen, Kaizhong]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China

Reprint Author's Address:

  • [liang, yi]faculty of information technology, beijing university of technology, beijing; 100124, china

Show more details

Related Keywords:

Related Article:

Source :

ISSN: 0302-9743

Year: 2020

Volume: 12093 LNCS

Page: 123-137

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 1

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 2

Online/Total:345/10564492
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.