• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Lu, Jiaxuan (Lu, Jiaxuan.) | Wan, Hai (Wan, Hai.) | Li, Peiyan (Li, Peiyan.) | Zhao, Xibin (Zhao, Xibin.) | Ma, Nan (Ma, Nan.) (Scholars:马楠) | Gao, Yue (Gao, Yue.)

Indexed by:

EI Scopus SCIE

Abstract:

Person re- identification (Re-ID) has become a hot research topic due to its widespread applications. Conducting person Re-ID in video sequences is a practical requirement, in which the crucial challenge is how to pursue a robust video representation based on spatial and temporal features. However, most of the previous methods only consider how to integrate part-level features in the spatio-temporal range, while how to model and generate the part-correlations is little exploited. In this paper, we propose a skeleton-based dynamic hypergraph framework, namely Skeletal Temporal Dynamic Hypergraph Neural Network (ST-DHGNN) for person Re-ID, which resorts to modeling the high-order correlations among various body parts based on a time series of skeletal information. Specifically, multi-shape and multi-scale patches are heuristically cropped from feature maps, constituting spatial representations in different frames. A joint-centered hypergraph and a bone-centered hypergraph are constructed in parallel from multiple body parts (i.e., head, trunk, and legs) with spatio-temporal multi-granularity in the entire video sequence, in which the graph vertices representing regional features and hyperedges denoting relationships. Dynamic hypergraph propagation containing the re- planning module and the hyperedge elimination module is proposed to better integrate features among vertices. Feature aggregation and attention mechanisms are also adopted to obtain a better video representation for person Re-ID. Experiments show that the proposed method performs significantly better than the state-of-the-art on three video-based person Re-ID datasets, including iLIDS-VID, PRID-2011, and MARS.

Keyword:

hypergraph Task analysis Person re-identification Video sequences Feature extraction Legged locomotion Correlation spatio-temporal correlation Head Joints hypergraph learning

Author Community:

  • [ 1 ] [Lu, Jiaxuan]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China
  • [ 2 ] [Wan, Hai]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China
  • [ 3 ] [Zhao, Xibin]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China
  • [ 4 ] [Gao, Yue]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China
  • [ 5 ] [Li, Peiyan]Columbia Univ, Dept Stat, New York, NY 10027 USA
  • [ 6 ] [Ma, Nan]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing 100124, Peoples R China

Reprint Author's Address:

  • [Gao, Yue]Tsinghua Univ, Sch Software, BNRist, THUIBCS,KLISS,BLBCI, Beijing 100084, Peoples R China;;[Ma, Nan]Beijing Univ Technol, Beijing Inst Artificial Intelligence, Beijing 100124, Peoples R China;;

Show more details

Related Keywords:

Related Article:

Source :

IEEE TRANSACTIONS ON IMAGE PROCESSING

ISSN: 1057-7149

Year: 2023

Volume: 32

Page: 949-963

1 0 . 6 0 0

JCR@2022

ESI Discipline: ENGINEERING;

ESI HC Threshold:19

Cited Count:

WoS CC Cited Count: 13

SCOPUS Cited Count: 21

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 12

Affiliated Colleges:

Online/Total:361/10629546
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.