• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

He, Z. (He, Z..) | Zhu, Q. (Zhu, Q..) | Xia, K. (Xia, K..) | Ghamisi, P. (Ghamisi, P..) | Zu, B. (Zu, B..)

Indexed by:

EI Scopus SCIE

Abstract:

Transformer has achieved outstanding performance in many fields such as computer vision benefiting from its powerful and efficient modelling ability and long-range feature extraction capability complementary to convolution. However, on the one hand, the lack of CNN’s innate inductive biases, such as translation invariance and local sensitivity, makes Transformer require more data for learning. On the other hand, labelled hyperspectral samples are scarce due to the time-consuming and costly annotation task. To this end, we propose a semi-supervised hierarchical Transformer model for HSI classification to improve the classification performance of the Transformer with limited labelled samples. In order to perturb the samples more fully and extensively to improve the model performance, two different data augmentation methods are used to perturb the unlabelled samples, and two sets of augmented samples are obtained respectively. The pseudo-label obtained on the original unlabelled sample is used to simultaneously supervise the augmented sample obtained on this unlabelled sample. Among them, only the pseudo-labels above the threshold are retained. To further improve the model stability and classification accuracy, hierarchical patch embedding is proposed to eliminate the mutual interference between pixels. Extensive experiments on three well-known hyperspectral datasets validate the effectiveness of the proposed semi-supervised Transformer model. The experiments show that the model achieves excellent classification accuracy even when there are only 10 labelled samples in each category, which can effectively improve the classification performance of Transformer under small-scale labelled samples. © 2023 Informa UK Limited, trading as Taylor & Francis Group.

Keyword:

transformer hyperspectral image classification Hierarchical patch embedding semi-supervised learning

Author Community:

  • [ 1 ] [He Z.]School of Computer and Communication Engineering, Changsha University of Science and Technology, Changsha, China
  • [ 2 ] [Zhu Q.]School of Computer and Communication Engineering, Changsha University of Science and Technology, Changsha, China
  • [ 3 ] [Xia K.]School of Electronics and Information Engineering, Hebei University of Technology, Tianjin, China
  • [ 4 ] [Ghamisi P.]Helmholtz-Zentrum Dresden-Rossendorf (HZDR), Helmholtz Institute Freiberg for Resource Technology, Freiberg, Germany
  • [ 5 ] [Ghamisi P.]AI4RS (artificial intelligence for remote sensing), Institute of Advanced Research in Artificial Intelligence (IARAI), Vienna, Austria
  • [ 6 ] [Zu B.]Faculty of Information Technology, Beijing University of Technology, Beijing, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

International Journal of Remote Sensing

ISSN: 0143-1161

Year: 2024

Issue: 1

Volume: 45

Page: 21-50

3 . 4 0 0

JCR@2022

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 2

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 7

Affiliated Colleges:

Online/Total:327/10509981
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.