• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Jia, Xibin (Jia, Xibin.) (Scholars:贾熹滨) | Xu, Shaowu (Xu, Shaowu.) | Zhou, Yuhan (Zhou, Yuhan.) | Wang, Luo (Wang, Luo.) | Li, Weiting (Li, Weiting.)

Indexed by:

EI Scopus SCIE

Abstract:

Facial Action Unit (AU) recognition is a challenging problem, where the subtle muscle movement brings diverse AU representations. Recently, AU relations are utilized to assist AU recognition and improve the understanding of AUs. Nevertheless, simply adopting the regular Bayesian networks or the relations between AUs and emotions is not enough for modelling complex AU relations. To provide quantitative measurement of AU relations using the knowledge from FACS, we propose an AU relation quantization autoencoder. Moreover, to cope with the diversity of AUs generated from the individual representation differences and other environmental impacts, we propose a dual-channel graph convolutional neural network (DGCN) obtaining both inherent and random AU relations. The first channel is FACS-based relation graph convolution channel (FACS-GCN) embedding prior knowledge of FACS, and it adjusts the network to the inherent AU dependent relations. The second channel is data-learning-based relation graph convolution channel (DLR-GCN) based on metric learning, and it provides robustness for individual differences and environmental changes. Comprehensive experiments have been conducted on three public datasets: CK+, RAF-AU and DISFA. The experimental results demonstrate that our proposed DGCN can extract the hidden relations well, thereby achieving great performance in AU recognition. (c) 2023 Published by Elsevier B.V.

Keyword:

Metric learning GCN FACS Dual-channel graph convolutional neural AU relation network

Author Community:

  • [ 1 ] [Jia, Xibin]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 2 ] [Xu, Shaowu]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 3 ] [Zhou, Yuhan]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 4 ] [Wang, Luo]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China
  • [ 5 ] [Li, Weiting]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China

Reprint Author's Address:

  • [Jia, Xibin]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China;;[Wang, Luo]Beijing Univ Technol, Fac Informat Technol, Pingleyuan 100, Beijing 100124, Peoples R China;;

Show more details

Related Keywords:

Source :

PATTERN RECOGNITION LETTERS

ISSN: 0167-8655

Year: 2023

Volume: 166

Page: 61-68

5 . 1 0 0

JCR@2022

ESI Discipline: ENGINEERING;

ESI HC Threshold:19

Cited Count:

WoS CC Cited Count: 7

SCOPUS Cited Count: 10

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 19

Affiliated Colleges:

Online/Total:776/10721312
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.