• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Mu, Guangyu (Mu, Guangyu.) | Chen, Chuanzhi (Chen, Chuanzhi.) | Li, Xiurong (Li, Xiurong.) | Li, Jiaxue (Li, Jiaxue.) | Ju, Xiaoqing (Ju, Xiaoqing.) | Dai, Jiaxiu (Dai, Jiaxiu.)

Indexed by:

EI Scopus SCIE

Abstract:

Accurate identification of sentiments in government-related comments is crucial for policymakers to deeply understand public opinion, adjust policies promptly, and enhance overall satisfaction. Thus, we create a model for emotion recognition in multimodal sentiment analysis of government information comments based on contrastive learning and cross-attention fusion networks. Firstly, we collect text-image comments from Today's Headlines App's Politics and Law section and extract textual and visual features. We fine-tune the model with LoRA and optimize the feature representation by making low-rank adjustments to the fused features. Secondly, we utilize contrastive learning with reverse prediction to analyze intra-class and inter-class cross-modal dynamics. Then, we propose a novel fusion network that utilizes cross-attention to learn the complementary relationship between different modalities. Finally, the features are combined using the fully connected layer. The experiment illustrates that the model achieves a 96.80% accuracy in recognizing emotion polarity. Compared with the multimodal model CLIP, the accuracy of the proposed method is improved by 10.21%. The model could assist the government in emotional evolution analysis, detection of public opinion, and online public opinion guidance.

Keyword:

fusion networks Feature extraction Analytical models Accuracy Information systems Sentiment analysis Dictionaries Multimodal sensors Contrastive learning Emotion recognition Government information comments Social networking (online) Government Semantics cross-attention contrastive learning multimodal sentiment analysis

Author Community:

  • [ 1 ] [Mu, Guangyu]Jilin Univ Finance & Econ, Sch Management Sci & Informat Engn, Changchun 130117, Peoples R China
  • [ 2 ] [Chen, Chuanzhi]Jilin Univ Finance & Econ, Sch Management Sci & Informat Engn, Changchun 130117, Peoples R China
  • [ 3 ] [Li, Jiaxue]Jilin Univ Finance & Econ, Sch Management Sci & Informat Engn, Changchun 130117, Peoples R China
  • [ 4 ] [Ju, Xiaoqing]Jilin Univ Finance & Econ, Sch Management Sci & Informat Engn, Changchun 130117, Peoples R China
  • [ 5 ] [Dai, Jiaxiu]Jilin Univ Finance & Econ, Sch Management Sci & Informat Engn, Changchun 130117, Peoples R China
  • [ 6 ] [Chen, Chuanzhi]Key Lab Financial Technol Jilin Prov, Changchun 130117, Peoples R China
  • [ 7 ] [Li, Xiurong]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China

Reprint Author's Address:

  • [Li, Xiurong]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China;;

Show more details

Related Keywords:

Source :

IEEE ACCESS

ISSN: 2169-3536

Year: 2024

Volume: 12

Page: 165525-165538

3 . 9 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 1

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 7

Affiliated Colleges:

Online/Total:468/10590763
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.