• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Xie, Bochen (Xie, Bochen.) | Deng, Yongjian (Deng, Yongjian.) | Shao, Zhanpeng (Shao, Zhanpeng.) | Liu, Hai (Liu, Hai.) | Xu, Qingsong (Xu, Qingsong.) | Li, Youfu (Li, Youfu.)

Indexed by:

CPCI-S EI Scopus

Abstract:

Event cameras asynchronously capture pixel-level intensity changes in scenes and output a stream of events. Compared with traditional frame-based cameras, they can offer competitive imaging characteristics: low latency, high dynamic range, and low power consumption. It means that event cameras are ideal for vision tasks in dynamic scenarios, such as human action recognition. The best-performing event-based algorithms convert events into frame-based representations and feed them into existing learning models. However, generating informative frames for long-duration event streams is still a challenge since event cameras work asynchronously without a fixed frame rate. In this work, we propose a novel frame-based representation named Compact Event Image (CEI) for action recognition. This representation is generated by a self-attention based module named Event Tubelet Compressor (EVTC) in a learnable way. The EVTC module adaptively summarizes the long-term dynamics and temporal patterns of events into a CEI frame set. We can combine EVTC with conventional video backbones for end-to-end event-based action recognition. We evaluate our approach on three benchmark datasets, and experimental results show it outperforms state-of-the-art methods by a large margin.

Keyword:

self-attention mechanism representation learning human action recognition event camera

Author Community:

  • [ 1 ] [Xie, Bochen]City Univ Hong Kong, Dept Mech Engn, Hong Kong, Peoples R China
  • [ 2 ] [Li, Youfu]City Univ Hong Kong, Dept Mech Engn, Hong Kong, Peoples R China
  • [ 3 ] [Deng, Yongjian]Beijing Univ Technol, Coll Comp Sci, Beijing, Peoples R China
  • [ 4 ] [Shao, Zhanpeng]Hunan Normal Univ, Coll Informat Sci & Engn, Changsha, Peoples R China
  • [ 5 ] [Liu, Hai]Cent China Normal Univ, Natl Engn Res Ctr E Learning, Wuhan, Peoples R China
  • [ 6 ] [Xu, Qingsong]Univ Macau, Dept Electromech Engn, Macau, Peoples R China

Reprint Author's Address:

Show more details

Related Keywords:

Source :

2022 7TH INTERNATIONAL CONFERENCE ON CONTROL, ROBOTICS AND CYBERNETICS, CRC

Year: 2022

Page: 12-16

Cited Count:

WoS CC Cited Count: 2

SCOPUS Cited Count: 3

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 7

Affiliated Colleges:

Online/Total:475/10557198
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.