• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Du, Y. (Du, Y..) | Yin, Z. (Yin, Z..) | Xie, R. (Xie, R..) | Zhang, Q. (Zhang, Q..)

Indexed by:

EI Scopus SCIE

Abstract:

Aspect-based Sentiment Analysis (ABSA) aims to predict the sentiment polarity towards a particular aspect in a sentence. Most of the existing methods construct neural networks or fine-tune the pre-trained language models. However, it is difficult to fully utilize the knowledge of language model learned during pretraining process, and it usually performs worse in few-shot experiment. Prompt learning can alleviate the above problems effectively. Manual prompt template construction methods are adopted usually but it leads to high costs and low efficiency, and there are seldom prompt templates applicable to ABSA task. We propose a method for ABSA prompt template construction, named Average Gradient Search with External Knowledge Based on KNN. The vocabulary list of the pre-trained language model is built as a KD-Tree, and the KNN algorithm is used to search the best prompt template on KD-Tree. For the sentiment polarity prediction, the best prompt template is used to wrap the ABSA data, converting the classification task to generative task, which enables the language model to fully leverage the learned knowledge from the pre-training stage. Moreover, the constructed verbalizer incorporates external knowledge to provide label words of each class with extensive semantic coverage and lower subjective bias. The comparison experimental results on SemEval2014 Restaurant and Laptop datasets demonstrate that the proposed method outperforms the existing SOTA models. Further, the few-shot experimental results indicate that, with only a small number of training samples, the proposed method achieves comparable or even better performance than the baseline model trained on the full dataset. © 2023 Elsevier Ltd

Keyword:

Natural Language Processing Average Gradient Search Pre-trained language model Aspect-based Sentiment Analysis Prompt learning External knowledge

Author Community:

  • [ 1 ] [Du Y.]Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
  • [ 2 ] [Yin Z.]Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
  • [ 3 ] [Xie R.]Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
  • [ 4 ] [Zhang Q.]Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

Expert Systems with Applications

ISSN: 0957-4174

Year: 2024

Volume: 238

8 . 5 0 0

JCR@2022

ESI Discipline: ENGINEERING;

ESI HC Threshold:3

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count: 9

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 12

Affiliated Colleges:

Online/Total:1290/10572439
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.