• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Wang, Liyuan (Wang, Liyuan.) | Zhang, Jing (Zhang, Jing.) | Wang, Meng (Wang, Meng.) | Tian, Jimiao (Tian, Jimiao.) | Zhuo, Li (Zhuo, Li.)

Indexed by:

EI Scopus SCIE

Abstract:

Live video hosted by streamers is being sought after by an increasing number of Internet users. Some streamers mix pornographic content with live video for profit and popularity, but this greatly harms the network environment. To effectively identify porn streamers, a multilevel fusion method of multimodal deep features for porn streamer recognition in live video is proposed in this paper. (1) Visual and audio features including spatial, audio, motion, and temporal context in live video are extracted by a multi modal deep network. (2) Audio-visual attention features are obtained by fusing visual and audio features at the feature level based on a multimodal attention mechanism. (3) Text features are extracted by using the bullet screen text network based on the BERT (bidirectional encoder representations from transformers) model after collecting text information from the viewers' bullet screen comments. (4) The prediction results of the audio-visual deep network and the bullet screen text network are fused at the decision level to improve the porn streamer recognition accuracy. We build a real-world dataset of porn streamers and conduct experiments and demonstrate that our method can improve the porn streamer recognition accuracy. (C) 2020 Elsevier B.V. All rights reserved.

Keyword:

Multilevel fusion Live video Porn streamer recognition Multimodal deep features Bullet screen text

Author Community:

  • [ 1 ] [Wang, Liyuan]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 2 ] [Zhang, Jing]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 3 ] [Tian, Jimiao]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 4 ] [Zhuo, Li]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
  • [ 5 ] [Wang, Liyuan]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 6 ] [Zhang, Jing]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 7 ] [Tian, Jimiao]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 8 ] [Zhuo, Li]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 9 ] [Wang, Meng]Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China

Reprint Author's Address:

  • [Zhang, Jing]Beijing Univ Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China;;[Zhang, Jing]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China

Show more details

Related Keywords:

Source :

PATTERN RECOGNITION LETTERS

ISSN: 0167-8655

Year: 2020

Volume: 140

Page: 150-157

5 . 1 0 0

JCR@2022

ESI Discipline: ENGINEERING;

ESI HC Threshold:115

Cited Count:

WoS CC Cited Count: 2

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:1235/10846291
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.