• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Lan, Z. (Lan, Z..) | Liu, L. (Liu, L..) | Fan, B. (Fan, B..) | Lv, Y. (Lv, Y..) | Ren, Y. (Ren, Y..) | Cui, Z. (Cui, Z..)

Indexed by:

Scopus

Abstract:

Predicting the future trajectories of dynamic traffic actors is a cornerstone task in autonomous driving. Though existing notable efforts have resulted in impressive performance improvements, a gap persists in scene cognitive and understanding of complex traffic semantics. This paper proposes Traj-LLM, the first to investigate the potential of using pre-trained Large Language Models (LLMs) without explicit prompt engineering to generate future motions from vehicular past trajectories and traffic scene semantics. Traj-LLM starts with sparse context joint encoding to dissect the agent and scene features into a form that LLMs understand. On this basis, we creatively explore LLMs' strong understanding capability to capture a spectrum of high-level scene knowledge and interactive information. To emulate the human-like lane focus cognitive function and enhance Traj-LLM's scene comprehension, we introduce lane-aware probabilistic learning powered by the Mamba module. Finally, a multi-modal Laplace decoder is designed to achieve scene-compliant predictions. Extensive experiments manifest that Traj-LLM, fueled by prior knowledge and understanding prowess of LLMs, together with lane-aware probability learning, transcends the state-of-the-art methods across most evaluation metrics. Moreover, the few-shot analysis serves to substantiate Traj-LLM's performance, as even with merely 50% of the dataset, it surpasses the majority of benchmarks relying on complete data utilization. This study explores endowing the trajectory prediction task with advanced capabilities inherent in LLMs, furnishing a more universal and adaptable solution for forecasting agent movements in a new way. IEEE

Keyword:

large language models (LLMs) Autonomous vehicles mamba trajectory prediction

Author Community:

  • [ 1 ] [Lan Z.]School of Transportation Science and Engineering, Beihang University, Beijing, China
  • [ 2 ] [Liu L.]School of Transportation Science and Engineering, Beihang University, Beijing, China
  • [ 3 ] [Fan B.]Beijing Key Laboratory of Traffic Engineering, College of Metropolitan Transportation, Beijing University of Technology, Beijing, China
  • [ 4 ] [Lv Y.]State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China
  • [ 5 ] [Ren Y.]School of Transportation Science and Engineering, State Key Lab of Intelligent Transportation System, Beihang University, Beijing, China
  • [ 6 ] [Cui Z.]School of Transportation Science and Engineering, State Key Lab of Intelligent Transportation System, Beihang University, Beijing, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Intelligent Vehicles

ISSN: 2379-8858

Year: 2024

Page: 1-14

8 . 2 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 9

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 3

Affiliated Colleges:

Online/Total:776/10615196
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.