• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Chen, Wenyuan (Chen, Wenyuan.) | Li, Guangyong (Li, Guangyong.) | Li, Mingwei (Li, Mingwei.) | Wang, Wenxue (Wang, Wenxue.) | Li, Peng (Li, Peng.) | Xue, Xiujuan (Xue, Xiujuan.) | Zhao, Xingang (Zhao, Xingang.) | Liu, Lianqing (Liu, Lianqing.)

Indexed by:

EI Scopus SCIE

Abstract:

It remains a formidable challenge to accurately recognize motion intentions of patients thus to control hand exoskeletons according to their volition. Current methods primarily focus on recognition of limited patient's motion intentions, with the purpose of controlling preconfigured gestures of a hand exoskeleton for grasping objects. These methods exhibit a marked shortfall when encountering scenarios that are unexpected or not designed in advance, such as non-preprogrammed hand movements and object manipulation tasks. To tackle this issue, large language model (LLM) and speech recognition technology are employed in this study to allow the patient to control a hand exoskeleton at will. In particular, two LLMs are tailored to formulate codes of either generating non-preprogrammed gestures or dealing with unencountered objects. Additionally, an incremental learning framework is proposed to enable patients to perform both predefined and non-predefined operation tasks by integrating a natural language parser with the two LLM-based learners. The natural language parser can directly control the hand exoskeleton to perform predefined operations tasks from prestored command set, while the LLM-based learners can incrementally expand the control command set so as to enhance adaptability of the hand exoskeleton to complex activities over daily use. This study is a pioneering work in the field of hand exoskeletons, which will revolutionize the way to control hand exoskeletons. Furthermore, the proposed framework can be easily generalized to any other robots by modifying the prompt of customized LLMs, which provides a new idea to achieve autonomous learning in robotics.

Keyword:

Task analysis large language model (LLM) Hand exoskeleton Robots ChatGPT incremental learning Automation Grasping Thumb Control systems motion intention recognition Exoskeletons

Author Community:

  • [ 1 ] [Chen, Wenyuan]Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
  • [ 2 ] [Wang, Wenxue]Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
  • [ 3 ] [Xue, Xiujuan]Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
  • [ 4 ] [Liu, Lianqing]Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
  • [ 5 ] [Chen, Wenyuan]Chinese Acad Sci, Inst Robot & Intelligent Mfg, Shenyang 110016, Peoples R China
  • [ 6 ] [Chen, Wenyuan]Univ Chinese Acad Sci, Beijing 100049, Peoples R China
  • [ 7 ] [Li, Guangyong]Univ Pittsburgh, Swanson Sch Engn, Dept Elect & Comp Engn, Pittsburgh, PA 15260 USA
  • [ 8 ] [Li, Mingwei]Beijing Univ Technol BJUT, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 9 ] [Li, Peng]Beijing Univ Technol BJUT, Fac Informat Technol, Beijing 100124, Peoples R China
  • [ 10 ] [Xue, Xiujuan]Rehabil Ctr Disabled, Shenyang 110015, Peoples R China

Reprint Author's Address:

  • [Liu, Lianqing]Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China;;[Li, Guangyong]Univ Pittsburgh, Swanson Sch Engn, Dept Elect & Comp Engn, Pittsburgh, PA 15260 USA

Show more details

Related Keywords:

Source :

IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING

ISSN: 1545-5955

Year: 2024

Volume: 22

Page: 2617-2626

5 . 6 0 0

JCR@2022

Cited Count:

WoS CC Cited Count: 1

SCOPUS Cited Count: 5

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 4

Affiliated Colleges:

Online/Total:607/10838412
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.