• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Ma Miaoli (Ma Miaoli.) | Wu Xiaolong (Wu Xiaolong.) | Han Honggui (Han Honggui.) (Scholars:韩红桂)

Indexed by:

CPCI-S EI Scopus

Abstract:

Levenberg-Marquardt (LM) algorithm is commonly used for training radial basis function neural networks (RBFNN) due to its fast convergence. However, its successful application is limited by the vanishing gradient problem in the learning process. To solve this problem, an accelerated LM (ALM) algorithm is designed to improve the learning performance of RBFNN in this paper. First, an error information filtering mechanism (EIFM) is developed to discard training samples information that the RBFNN has already learned, then the same amount of computation can obtain the more error gradient information. Second, a width adjustment mechanism (WAM) is designed to help training samples escape from the saturated region of the activation function to increment gradient value. Finally, some benchmark and real problems are used to exhibition the effectiveness of proposed ALM algorithm. The results demonstrate the proposed ALM-RBFNN can effectively mitigate the vanishing gradient and has good learning performance.

Keyword:

accelerated Levenberg-Marquardt algorithm (ALM) width adjustment mechanism (WAM) Radial basis function neural network (RBFNN) error information filtering mechanism (EIFM)

Author Community:

  • [ 1 ] [Ma Miaoli]Beijing Univ Technol, Fac Informat Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing, Peoples R China
  • [ 2 ] [Wu Xiaolong]Beijing Univ Technol, Fac Informat Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing, Peoples R China
  • [ 3 ] [Han Honggui]Beijing Univ Technol, Fac Informat Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing, Peoples R China

Reprint Author's Address:

  • [Ma Miaoli]Beijing Univ Technol, Fac Informat Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing, Peoples R China

Show more details

Related Keywords:

Source :

2020 CHINESE AUTOMATION CONGRESS (CAC 2020)

ISSN: 2688-092X

Year: 2020

Page: 6804-6809

Language: English

Cited Count:

WoS CC Cited Count: 7

SCOPUS Cited Count: 10

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 10

Online/Total:349/10703429
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.