• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Duan, Lijuan (Duan, Lijuan.) (Scholars:段立娟) | Ge, Hui (Ge, Hui.) | Yang, Zhen (Yang, Zhen.) (Scholars:杨震) | Chen, Juncheng (Chen, Juncheng.)

Indexed by:

CPCI-S

Abstract:

This paper presents a multimodal fusion approach using kernel-based Extreme Learning Machine (ELM) for video emotion recognition by combing video content and electroencephalogram (EEG) signals. Firstly, several audio-based features and visual-based features are extracted from video clips and EEG features are obtained by using Wavelet Packet Decomposition (WPD). Secondly, video features are selected using Double Input Symmetrical Relevance (DISR) and EEG features are selected by Decision Tree (DT). Thirdly, multimodal fusion using kernel-based ELM is adopted for classification by combing video and EEG features at decision-level. In order to test the validity of the proposed method, we design and conduct the EEG experiment to collect data that consisted of video clips and EEG signals of subjects. We compare our method separately with single mode methods of using video content only and EEG signals only on classification accuracy. The experimental results show that the proposed fusion method produces better classification performance than those of the video emotion recognition methods which use either video content or EEG signals alone.

Keyword:

Kernel-based ELM EEG Multimodal fusion Video emotion recognition

Author Community:

  • [ 1 ] [Duan, Lijuan]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 2 ] [Ge, Hui]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 3 ] [Yang, Zhen]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China
  • [ 4 ] [Duan, Lijuan]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100124, Peoples R China
  • [ 5 ] [Ge, Hui]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100124, Peoples R China
  • [ 6 ] [Chen, Juncheng]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Integrat & Anal Large Scale Strea, Beijing 100124, Peoples R China

Reprint Author's Address:

  • 杨震

    [Yang, Zhen]Beijing Univ Technol, Coll Comp Sci & Technol, Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China

Show more details

Related Keywords:

Related Article:

Source :

PROCEEDINGS OF ELM-2015, VOL 1: THEORY, ALGORITHMS AND APPLICATIONS (I)

ISSN: 2363-6084

Year: 2016

Volume: 6

Page: 371-381

Language: English

Cited Count:

WoS CC Cited Count: 5

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 13

Online/Total:674/10654547
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.