• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Shi, Ge (Shi, Ge.) | Deng, Sinuo (Deng, Sinuo.) | Wang, Bo (Wang, Bo.) | Feng, Chong (Feng, Chong.) | Zhuang, Yan (Zhuang, Yan.) | Wang, Xiaomei (Wang, Xiaomei.)

Indexed by:

EI Scopus SCIE

Abstract:

Image Emotion Classification (IEC) is an essential research area, offering valuable insights into user emotional states for a wide range of applications, including opinion mining, recommendation systems, and mental health treatment. The challenges associated with IEC are mainly attributed to the complexity and ambiguity of human emotions, the lack of a universally accepted emotion model, and excessive dependence on prior knowledge. To address these challenges, we propose a novel Unified Generative framework for Image Emotion Classification (UGRIE), which is capable of simultaneously modeling various emotion models and capturing intricate semantic relationships between emotion labels. Our approach employs a flexible natural language template, converting the IEC task into a template-filling process that can be easily adapted to accommodate a diverse range of IEC tasks. To further enhance the performance, we devise a mapping mechanism to seamlessly integrate the multimodal pre-training model CLIP with the text generation pre-training model BART, thus leveraging the strengths of both models. A comprehensive set of experiments conducted on multiple public datasets demonstrates that our proposed method consistently outperforms existing approaches to a large margin in supervised settings, exhibits remarkable performance in low-resource scenarios, and unifies distinct emotion models within a single, versatile framework.

Keyword:

Task analysis Adaptation models Emotion recognition images emotion classification multi-modal learning Semantics Data models Psychology IEC Pre-training model

Author Community:

  • [ 1 ] [Shi, Ge]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 2 ] [Deng, Sinuo]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 3 ] [Shi, Ge]Beijing Zhongke Huili Technol Co Ltd, Beijing 100085, Peoples R China
  • [ 4 ] [Wang, Bo]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 5 ] [Feng, Chong]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China
  • [ 6 ] [Zhuang, Yan]Chinese Peoples Liberat Army Gen Hosp, Beijing 100039, Peoples R China
  • [ 7 ] [Wang, Xiaomei]Chinese Acad Sci, Inst Sci & Dev, Beijing 100190, Peoples R China

Reprint Author's Address:

  • [Feng, Chong]Beijing Inst Technol, Sch Comp Sci, Beijing 100081, Peoples R China;;

Show more details

Related Keywords:

Related Article:

Source :

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY

ISSN: 1051-8215

Year: 2024

Issue: 8

Volume: 34

Page: 7057-7068

8 . 4 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 10

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Affiliated Colleges:

Online/Total:1728/10967219
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.