• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Zhang, Kai (Zhang, Kai.) | Zhang, Yongtai (Zhang, Yongtai.) | Zhang, Liwei (Zhang, Liwei.) | Gao, Hongyu (Gao, Hongyu.) | Yan, Rongjie (Yan, Rongjie.) | Yan, Jun (Yan, Jun.)

Indexed by:

CPCI-S EI Scopus

Abstract:

Deep neural networks (DNNs) have been increasingly adopted in various applications. Systematic verification and validation is essential to guarantee the quality of such systems. Due to the scalability problem, formal methods can hardly be widely applied in practice. Testing is one of feasible solutions. However, lacking of input space specification for DNNs requires a large set of test cases to he constructed to increase the testing adequacy, which leads to high labeling cost of test cases. In this paper, we put forwards a test case prioritization method 14 DNN classifiers, which assigns high priorities to those cases that could lead to wrong classifications. The priorities are calculated according to the activation pattern of neurons acquired from the training sets and the activated neurons collected from certain inputs. For a trained model, the method consists of two steps. First, we accumulate neuron activation patterns over the training set, and construct a set of frequently activated neurons based on the frequency (times) of activation for every class. Second, the metrics are computed according to the comparison between the activated neurons of an input and the selected set of frequently activated neurons with iLs output The experimentation is carried out over three popular datasets with various neural network structures. The results demonstrate that the test cases with higher priorities are more prone to be mis-classified. And the prioritized lest cases over a DNN model within same datasets are also efficient in triggering mis-classilication of other DNNs with similar structures.

Keyword:

Feature Extraction Test Case Prioritization Classifier Deep Neural Network

Author Community:

  • [ 1 ] [Zhang, Kai]Beijing Univ Technol, Coll Comp, Beijing, Peoples R China
  • [ 2 ] [Zhang, Yongtai]Beijing Univ Technol, Coll Comp, Beijing, Peoples R China
  • [ 3 ] [Gao, Hongyu]Beijing Univ Technol, Coll Comp, Beijing, Peoples R China
  • [ 4 ] [Yan, Rongjie]Chinese Acad Sci, State Key Lab Comp Sci, Beijing, Peoples R China
  • [ 5 ] [Yan, Jun]Chinese Acad Sci, State Key Lab Comp Sci, Beijing, Peoples R China
  • [ 6 ] [Zhang, Liwei]Univ Chinese Acad Sci, Beijing, Peoples R China
  • [ 7 ] [Yan, Jun]Univ Chinese Acad Sci, Beijing, Peoples R China

Reprint Author's Address:

  • [Yan, Rongjie]Chinese Acad Sci, State Key Lab Comp Sci, Beijing, Peoples R China

Show more details

Related Keywords:

Related Article:

Source :

2020 INTERNATIONAL SYMPOSIUM ON THEORETICAL ASPECTS OF SOFTWARE ENGINEERING (TASE 2020)

Year: 2020

Page: 81-88

Language: English

Cited Count:

WoS CC Cited Count: 8

SCOPUS Cited Count: 12

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 5

Online/Total:692/10708325
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.