• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Qiao, Junfei (Qiao, Junfei.) (Scholars:乔俊飞) | Li, Fanjun (Li, Fanjun.) | Han, Honggui (Han, Honggui.) (Scholars:韩红桂) | Li, Wenjing (Li, Wenjing.)

Indexed by:

Scopus SCIE

Abstract:

An echo-state network (ESN) is an effective alternative to gradient methods for training recurrent neural network. However, it is difficult to determine the structure (mainly the reservoir) of the ESN to match with the given application. In this paper, a growing ESN (GESN) is proposed to design the size and topology of the reservoir automatically. First, the GESN makes use of the block matrix theory to add hidden units to the existing reservoir group by group, which leads to a GESN with multiple subreservoirs. Second, every subreservoir weight matrix in the GESN is created with a predefined singular value spectrum, which ensures the echo-sate property of the ESN without posterior scaling of the weights. Third, during the growth of the network, the output weights of the GESN are updated in an incremental way. Moreover, the convergence of the GESN is proved. Finally, the GESN is tested on some artificial and real-world time-series benchmarks. Simulation results show that the proposed GESN has better prediction performance and faster leaning speed than some ESNs with fixed sizes and topologies.

Keyword:

recurrent neural network (RNN) growing echo-state network (GESN) Echo-state network (ESN) reservoir time-series prediction

Author Community:

  • [ 1 ] [Qiao, Junfei]Beijing Univ Technol, Coll Elect Informat & Control Engn, Beijing 100124, Peoples R China
  • [ 2 ] [Li, Fanjun]Beijing Univ Technol, Coll Elect Informat & Control Engn, Beijing 100124, Peoples R China
  • [ 3 ] [Han, Honggui]Beijing Univ Technol, Coll Elect Informat & Control Engn, Beijing 100124, Peoples R China
  • [ 4 ] [Li, Wenjing]Beijing Univ Technol, Coll Elect Informat & Control Engn, Beijing 100124, Peoples R China
  • [ 5 ] [Qiao, Junfei]Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 6 ] [Li, Fanjun]Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 7 ] [Han, Honggui]Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 8 ] [Li, Wenjing]Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 9 ] [Li, Fanjun]Univ Jinan, Sch Math Sci, Jinan 250022, Peoples R China

Reprint Author's Address:

  • 乔俊飞

    [Qiao, Junfei]Beijing Univ Technol, Coll Elect Informat & Control Engn, Beijing 100124, Peoples R China

Show more details

Related Keywords:

Related Article:

Source :

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS

ISSN: 2162-237X

Year: 2017

Issue: 2

Volume: 28

Page: 391-404

1 0 . 4 0 0

JCR@2022

ESI Discipline: COMPUTER SCIENCE;

ESI HC Threshold:175

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 138

SCOPUS Cited Count: 168

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Online/Total:641/10838383
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.