• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Duan, Lijuan (Duan, Lijuan.) | Xu, Xiao (Xu, Xiao.) | En, Qing (En, Qing.)

Abstract:

3D human dance generation from music is an interesting and challenging task in which the aim is to estimate 3D pose from visual and audio information. Existing methods only use skeleton information to complete this task, which may cause jittering results. In addition, due to lack of appropriate evaluation metrics for this task, it is difficult to evaluate the quality of the generated results. In this paper, the authors explore multi-modality dance generation networks through constructing the correspondence between the visual and the audio cues. Specifically, they propose a 2D prediction module to predict future frames by fusing visual and audio features. Moreover, they propose a 3D conversion module, which is able to generate the 3D skeleton from the 2D skeleton. In addition, some new human dance generation evaluation metrics are proposed to evaluate the quality of the generated results. Experimental results indicate that the proposed modules can meet the requirements of authenticity and diversity.

Keyword:

3D Pose LSTM Classification Metrics Multimodal Dance Generation Mixture Density Networks VAE Audio-Visual Skeleton

Author Community:

  • [ 1 ] [Duan, Lijuan]Beijing Univ Technol, Beijing, Peoples R China
  • [ 2 ] [Xu, Xiao]Beijing Univ Technol, Beijing, Peoples R China
  • [ 3 ] [En, Qing]Beijing Univ Technol, Comp Sci & Technol, Beijing, Peoples R China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Related Article:

Source :

INTERNATIONAL JOURNAL OF MULTIMEDIA DATA ENGINEERING & MANAGEMENT

ISSN: 1947-8534

Year: 2021

Issue: 1

Volume: 12

Page: 17-32

Cited Count:

WoS CC Cited Count: 0

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 4

Affiliated Colleges:

Online/Total:692/10675560
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.