• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Yang, J. (Yang, J..) | Liu, Y. (Liu, Y..) | Wang, W. (Wang, W..) | Wu, H. (Wu, H..) | Chen, Z. (Chen, Z..) | Ma, X. (Ma, X..)

Indexed by:

EI Scopus SCIE

Abstract:

The development of Neural Architecture Search (NAS) is hindered by high costs associated with evaluating network architectures. Recently, several zero-cost proxies have been proposed as a promising method to reduce the evaluation cost of network architectures in NAS. They can quickly estimate the final performance of the network in a few seconds during the initial phase. However, existing zero-cost proxies either ignore the network structure's impact on performance or are limited to specific tasks. To address these issues, we propose a novel zero-cost proxy called Skeleton Path Kernel Trace (SPKT) that leverages the whole network architecture's skeleton path structure information. We then integrate it into an effective Bayesian optimization for NAS framework called PATNAS, and demonstrate its efficacy on different datasets. The results show that our proposed SPKT zero-cost proxy can achieve a high correlation with the final performance of the network across multiple tasks. Furthermore, it can significantly accelerate the search process for finding the best-performing network architectures. © 1979-2012 IEEE.

Keyword:

neural architecture search Bayesian optimization zero-cost proxy

Author Community:

  • [ 1 ] [Yang J.]Renmin University of China, Beijing Key Laboratory of Big Data Management and Analysis Methods, Gaoling School of Artificial Intelligence, Beijing, 100872, China
  • [ 2 ] [Liu Y.]Renmin University of China, Beijing Key Laboratory of Big Data Management and Analysis Methods, Gaoling School of Artificial Intelligence, Beijing, 100872, China
  • [ 3 ] [Wang W.]Research Institute of China United Network Communications Corporation Limited, Beijing, 100083, China
  • [ 4 ] [Wu H.]Research Institute of China United Network Communications Corporation Limited, Beijing, 100083, China
  • [ 5 ] [Chen Z.]Beijing University of Technology, Computer Science and Technology, Beijing, 100032, China
  • [ 6 ] [Ma X.]Chinese Academy of Sciences (CASIA), State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Beijing, 100190, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

IEEE Transactions on Pattern Analysis and Machine Intelligence

ISSN: 0162-8828

Year: 2024

Issue: 3

Volume: 47

Page: 1484-1500

2 3 . 6 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 12

Affiliated Colleges:

Online/Total:386/10650807
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.