• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Li, Wen-Jing (Li, Wen-Jing.) | Li, Zhi-Gang (Li, Zhi-Gang.) | Qiao, Jun-Fei (Qiao, Jun-Fei.)

Indexed by:

EI Scopus

Abstract:

Because of faster convergence speed and superior fault tolerance, small-world neural network has attracted wide attention in recent years. However, in the construction process, it may cause the loss of important information due to random reconnection, which may lead to the decline of network accuracy. To solve this problem, derived from the Watts-Strogatz (WS) small-world neural network, a feedforward small-world neural network based on synaptic consolidation (FSWNN-SC) mechanism is proposed in this study. Firstly, the regular feedforward neural network is pre-trained by using the network regularization method. Based on the synaptic consolidation mechanism, the unimportant connection weights of the network are disconnected and the important connection weights are retained. Secondly, the rewiring rules are designed to construct a small-world neural network, which can realize the sparseness of the network while ensuring the small-world properties of the network. The gradient descent algorithm is used to train the network. Finally, four UCI benchmark experiments and two practical experiments are carried out to evaluate the model performance, and the Wilcoxon signed-ranks test is performed to test the significant differences between comparative models. Experimental results show that the FSWNN-SC model proposed in this study not only obtains a compact network structure, but also has significantly better accuracy than regular feedforward neural networks and other WS small-world neural networks. © 2023 Science Press. All rights reserved.

Keyword:

Distributed computer systems Feedforward neural networks Fault tolerance Benchmarking Gradient methods

Author Community:

  • [ 1 ] [Li, Wen-Jing]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 2 ] [Li, Wen-Jing]Beijing Artificial Intelligence Institute, Beijing; 100124, China
  • [ 3 ] [Li, Wen-Jing]Engineering Research Center of Intelligence Perception and Autonomous Control, Ministry of Education, Beijing; 100124, China
  • [ 4 ] [Li, Wen-Jing]Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing; 100124, China
  • [ 5 ] [Li, Wen-Jing]Beijing Laboratory for Intelligent Environmental Protection, Beijing; 100124, China
  • [ 6 ] [Li, Zhi-Gang]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 7 ] [Li, Zhi-Gang]Beijing Artificial Intelligence Institute, Beijing; 100124, China
  • [ 8 ] [Li, Zhi-Gang]Engineering Research Center of Intelligence Perception and Autonomous Control, Ministry of Education, Beijing; 100124, China
  • [ 9 ] [Li, Zhi-Gang]Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing; 100124, China
  • [ 10 ] [Li, Zhi-Gang]Beijing Laboratory for Intelligent Environmental Protection, Beijing; 100124, China
  • [ 11 ] [Qiao, Jun-Fei]Faculty of Information Technology, Beijing University of Technology, Beijing; 100124, China
  • [ 12 ] [Qiao, Jun-Fei]Beijing Artificial Intelligence Institute, Beijing; 100124, China
  • [ 13 ] [Qiao, Jun-Fei]Engineering Research Center of Intelligence Perception and Autonomous Control, Ministry of Education, Beijing; 100124, China
  • [ 14 ] [Qiao, Jun-Fei]Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing; 100124, China
  • [ 15 ] [Qiao, Jun-Fei]Beijing Laboratory for Intelligent Environmental Protection, Beijing; 100124, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

Acta Automatica Sinica

ISSN: 0254-4156

Year: 2023

Issue: 10

Volume: 49

Page: 2145-2158

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 4

Affiliated Colleges:

Online/Total:1266/10563734
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.