• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Li, Wenjing (Li, Wenjing.) | Wang, Xiaoxiao (Wang, Xiaoxiao.) | Han, Honggui (Han, Honggui.) | Qiao, Junfei (Qiao, Junfei.)

Indexed by:

EI Scopus SCIE

Abstract:

As an extensively used model for time series prediction, the Long–Short Term Memory (LSTM) neural network suffers from shortcomings such as high computational cost and large memory requirement, due to its complex structure. To address these problems, a PLS-based pruning algorithm is hereby proposed for a simplified LSTM (PSLSTM). First, a hybrid strategy is designed to simplify the internal structure of LSTM, which combines the structure simplification and parameter reduction for gates. Second, partial least squares (PLS) regression coefficients are used as the metric to evaluate the importance of the memory blocks, and the redundant hidden layer size is pruned by merging unimportant blocks with their most correlated ones. The Backpropagation Through Time (BPTT) algorithm is utilized as the learning algorithm to update the network parameters. Finally, several benchmark and practical datasets for time series prediction are used to evaluate the performance of the proposed PSLSTM. The experimental results demonstrate that the PLS-based pruning algorithm can achieve the trade-off between a good generalization ability and a compact network structure. The computational complexity is improved by the simple internal structure as well as the compact hidden layer size, without sacrificing prediction accuracy. © 2022 Elsevier B.V.

Keyword:

Benchmarking Time series Least squares approximations Forecasting Complex networks Economic and social effects Brain Long short-term memory

Author Community:

  • [ 1 ] [Li, Wenjing]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 2 ] [Li, Wenjing]Beijing Artificial Intelligence Institute, Beijing; 100124, China
  • [ 3 ] [Li, Wenjing]Engineering Research Center of Intelligence Perception and Autonomous Control, Ministry of Education, Beijing; 100124, China
  • [ 4 ] [Li, Wenjing]Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing; 100124, China
  • [ 5 ] [Li, Wenjing]Beijing Laboratory for Intelligent Environmental Protection, Beijing; 100124, China
  • [ 6 ] [Wang, Xiaoxiao]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 7 ] [Wang, Xiaoxiao]Beijing Artificial Intelligence Institute, Beijing; 100124, China
  • [ 8 ] [Wang, Xiaoxiao]Engineering Research Center of Intelligence Perception and Autonomous Control, Ministry of Education, Beijing; 100124, China
  • [ 9 ] [Wang, Xiaoxiao]Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing; 100124, China
  • [ 10 ] [Wang, Xiaoxiao]Beijing Laboratory for Intelligent Environmental Protection, Beijing; 100124, China
  • [ 11 ] [Han, Honggui]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 12 ] [Han, Honggui]Beijing Artificial Intelligence Institute, Beijing; 100124, China
  • [ 13 ] [Han, Honggui]Engineering Research Center of Intelligence Perception and Autonomous Control, Ministry of Education, Beijing; 100124, China
  • [ 14 ] [Han, Honggui]Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing; 100124, China
  • [ 15 ] [Han, Honggui]Beijing Laboratory for Intelligent Environmental Protection, Beijing; 100124, China
  • [ 16 ] [Qiao, Junfei]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 17 ] [Qiao, Junfei]Beijing Artificial Intelligence Institute, Beijing; 100124, China
  • [ 18 ] [Qiao, Junfei]Engineering Research Center of Intelligence Perception and Autonomous Control, Ministry of Education, Beijing; 100124, China
  • [ 19 ] [Qiao, Junfei]Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing; 100124, China
  • [ 20 ] [Qiao, Junfei]Beijing Laboratory for Intelligent Environmental Protection, Beijing; 100124, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

Knowledge-Based Systems

ISSN: 0950-7051

Year: 2022

Volume: 254

8 . 8

JCR@2022

8 . 8 0 0

JCR@2022

ESI Discipline: COMPUTER SCIENCE;

ESI HC Threshold:46

JCR Journal Grade:1

CAS Journal Grade:2

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 22

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 7

Affiliated Colleges:

Online/Total:624/10551593
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.