• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

He, Y. (He, Y..) | Li, J. (Li, J..) | Kong, D. (Kong, D..) | Yin, B. (Yin, B..)

Indexed by:

CPCI-S EI Scopus

Abstract:

3D hand pose estimation aims to infer the position information of hand joints from a single image, which is widely applied to virtual reality, natural human-computer interaction, autonomous driving and various other fields. Some methods treat all joints as a whole to estimate 3D hand pose and others divide the hand joints into different groups to regress the parts of hand. However, these methods don’t leverage the complementarity between global and local part poses. To address this issue, this paper proposes a novel dual-branch framework aiming at comprehensively capturing information about hand poses. One branch focuses on capturing the overall posture information of the hand, while the other one concentrates on detailed description of the palm joints and finger joints. This global-local dual-branch structure addresses the limitation of previous methods and can handle more complex gestures. To further enhance the association between the dual branches, this paper proposes a novel online knowledge distillation strategy. The proposed strategy integrates the prediction results of both branches to construct a teacher network and then transfers the knowledge learned by the teacher network back to two student networks. Therefore, this method can better learn knowledge that contains both global and local features. A series of experiments are conducted on publicly available STB and RHD datasets, and the experimental results validates the effectiveness of the proposed 3D hand pose estimation method. © The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

Keyword:

3D heatmap 3D hand pose estimation Hourglass network Online knowledge distillation Dual-branch

Author Community:

  • [ 1 ] [He Y.]Beijing Institute of Artificial Intelligence, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
  • [ 2 ] [Li J.]Beijing Institute of Artificial Intelligence, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
  • [ 3 ] [Kong D.]Beijing Institute of Artificial Intelligence, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China
  • [ 4 ] [Yin B.]Beijing Institute of Artificial Intelligence, Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

ISSN: 0302-9743

Year: 2024

Volume: 15018 LNCS

Page: 130-143

Language: English

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:566/10701139
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.