• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Jia, Xibin (Jia, Xibin.) | Zhou, Yuhan (Zhou, Yuhan.) | Li, Weiting (Li, Weiting.) | Li, Jinghua (Li, Jinghua.) | Yin, Baocai (Yin, Baocai.) (Scholars:尹宝才)

Indexed by:

EI Scopus SCIE

Abstract:

In the paper, we propose a novel Data-aware relation graph convolutional neural network (DAR-GCN) for AU recognition. With learning and updating the relation dynamically, it facilitates modeling the potential dynamic individual facial expressing manner and accordingly improves the AU recognition under the unconstrained environment. Taking the psychological research knowledge of AUs as a reference, we adopt the consensus widely-used AUs and six basic emotions as vertexes, and their co-occurrence or ex-occurrence relations between AUs and the emotion dependent relation as the edges to construct the graph. Moreover, the Data-aware relation Graph Generator (DAR-GG) module is proposed to learn the relations with data-driven metric learning. This proposed scheme is benefit for calculating and updating AU relations from data, which facilitates to extract specific relations causing by individual expressing characteristics as well as inherent relations due to facial anatomical structure. Comparative experiments are done on three public datasets: CK+, RAF-AU and DISFA. Experimental results demonstrate that our proposed method achieves a higher AU recognition accuracy rate than the baseline based on the graph with fixed AU relations defined from the psychological knowledge. Additionally, our proposed approach outperforms several existing state-of-the-art AU recognition method by utilizing GCN-based dynamic AU relations learning strategies. (C) 2022 Elsevier B.V. All rights reserved.

Keyword:

AU recognition Metric learning GCN FACS Relation representation

Author Community:

  • [ 1 ] [Jia, Xibin]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 2 ] [Zhou, Yuhan]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 3 ] [Li, Weiting]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 4 ] [Li, Jinghua]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 5 ] [Yin, Baocai]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 6 ] [Jia, Xibin]Beijing Municipal Key Lab Multimedia & Intelligen, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 7 ] [Li, Jinghua]Beijing Municipal Key Lab Multimedia & Intelligen, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 8 ] [Yin, Baocai]Beijing Municipal Key Lab Multimedia & Intelligen, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 9 ] [Jia, Xibin]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 10 ] [Li, Jinghua]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 11 ] [Yin, Baocai]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Pingleyuan 100, Beijing 100124, Peoples R China

Reprint Author's Address:

Show more details

Related Keywords:

Source :

PATTERN RECOGNITION LETTERS

ISSN: 0167-8655

Year: 2022

Volume: 155

Page: 100-106

5 . 1

JCR@2022

5 . 1 0 0

JCR@2022

ESI Discipline: ENGINEERING;

ESI HC Threshold:49

JCR Journal Grade:2

CAS Journal Grade:3

Cited Count:

WoS CC Cited Count: 4

SCOPUS Cited Count: 7

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 28

Affiliated Colleges:

Online/Total:303/10804097
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.