• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Yuan, Tongtong (Yuan, Tongtong.) | Li, Zulin (Li, Zulin.) | Liu, Bo (Liu, Bo.) | Tang, Yinan (Tang, Yinan.) | Liu, Yujia (Liu, Yujia.)

Indexed by:

EI Scopus SCIE

Abstract:

Structured pruning is a representative model compression technology for convolutional neural networks (CNNs), aiming to prune some less important filters or channels of CNNs. Most recent structured pruning methods have established some criteria to measure the importance of filters, which are mainly based on the magnitude of weights or other parameters in CNNs. However, these judgment criteria lack explainability, and it is insufficient to simply rely on the numerical values of the network parameters to assess the relationship between the channel and the model performance. Moreover, directly utilizing these pruning criteria for global pruning may lead to suboptimal solutions, therefore, it is necessary to complement search algorithms to determine the pruning ratio for each layer. To address these issues, we propose ARPruning (Attention -map -based Ranking Pruning), which reconstructs a new pruning criterion as the importance of the intra-layer channels and further develops a new local neighborhood search algorithm for determining the optimal inter -layer pruning ratio. To measure the relationship between the channel to be pruned and the model performance, we construct an intra-layer channel importance criterion by considering the attention map for each layer. Then, we propose an automatic pruning strategy searching method that can search for the optimal solution effectively and efficiently. By integrating the well -designed pruning criteria and search strategy, our ARPruning can not only maintain high compression rate but also achieve outstanding accuracy. In our work, it is also experimentally concluded that compared with state-of-the-art pruning methods, our ARPruning method is capable of achieving better compression results. The code can be obtained at https://github.com/dozingLee/ARPruning.

Keyword:

Image classification Model compression Pruning criteria Search algorithm

Author Community:

  • [ 1 ] [Yuan, Tongtong]Beijing Univ Technol, Beijing, Peoples R China
  • [ 2 ] [Li, Zulin]Beijing Univ Technol, Beijing, Peoples R China
  • [ 3 ] [Liu, Bo]Beijing Univ Technol, Beijing, Peoples R China
  • [ 4 ] [Liu, Yujia]Beijing Univ Technol, Beijing, Peoples R China
  • [ 5 ] [Tang, Yinan]Inspur Elect Informat Ind Co Ltd, Jinan, Peoples R China

Reprint Author's Address:

  • [Liu, Bo]Beijing Univ Technol, Beijing, Peoples R China;;

Show more details

Related Keywords:

Related Article:

Source :

NEURAL NETWORKS

ISSN: 0893-6080

Year: 2024

Volume: 174

7 . 8 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Affiliated Colleges:

Online/Total:1812/10948573
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.