• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Jiang, H. (Jiang, H..) | Li, Z. (Li, Z..) | Hu, Y. (Hu, Y..) | Yin, B. (Yin, B..) | Yang, J. (Yang, J..) | Hengel, A.V.D. (Hengel, A.V.D..) | Yang, M.-H. (Yang, M.-H..) | Qi, Y. (Qi, Y..)

Indexed by:

Scopus

Abstract:

Generalized zero-shot learning (GZSL) requires that models are able to recognize classes they were trained on, and new classes they haven't seen before. Feature-generation approaches are popular due to their effectiveness in mitigating overfitting to the training classes. Existing generative approaches usually adopt simple discriminators for distribution or classification supervision, however, thus limiting their ability to generate visual features that are discriminative of and transferable to novel categories. To overcome this limitation and improve the quality of generated features, we propose a dual prototype contrastive augmented discriminator for the generative adversarial network. Specifically, we design a Dual Prototype Contrastive Network (DPCN), which leverages complementary information between visual space and semantic space through multi-task prototype contrastive learning. Contrastive learning of the visual prototypes enhances the ability of the generated features to distinguish between classes, while the contrastive learning of the semantic prototypes improves their transferability. Furthermore, we introduce margins into the contrastive learning process to ensure both intra-class compactness and inter-class separation. To demonstrate the effectiveness of the proposed approach, we conduct experiments on three widely-used zero-shot learning benchmark datasets, where DPCN achieves state-of-the-art performance for GZSL.  © 1991-2012 IEEE.

Keyword:

Prototype Learning Generalized Zero-Shot Learning Contrastive Learning

Author Community:

  • [ 1 ] [Jiang H.]Beijing University of Technology, Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Beijing Institute of Artificial Intelligence, Faculty of Information Technology, Beijing, 100124, China
  • [ 2 ] [Li Z.]Beijing University of Technology, Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Beijing Institute of Artificial Intelligence, Faculty of Information Technology, Beijing, 100124, China
  • [ 3 ] [Hu Y.]Beijing University of Technology, Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Beijing Institute of Artificial Intelligence, Faculty of Information Technology, Beijing, 100124, China
  • [ 4 ] [Yin B.]Beijing University of Technology, Beijing Key Laboratory of Multimedia and Intelligent Software Technology, Beijing Institute of Artificial Intelligence, Faculty of Information Technology, Beijing, 100124, China
  • [ 5 ] [Yang J.]Macquarie University, Sydney, 2109, NSW, Australia
  • [ 6 ] [Hengel A.V.D.]University of Adelaide, Adelaide, 5000, SA, Australia
  • [ 7 ] [Yang M.-H.]University of California, Merced, 95343, CA, United States
  • [ 8 ] [Qi Y.]Macquarie University, Sydney, 2109, NSW, Australia

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

IEEE Transactions on Circuits and Systems for Video Technology

ISSN: 1051-8215

Year: 2024

Issue: 2

Volume: 35

Page: 1111-1122

8 . 4 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 1

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 9

Affiliated Colleges:

Online/Total:436/10804481
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.