• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Zhou, Ao (Zhou, Ao.) | Yang, Jianlei (Yang, Jianlei.) | Gao, Yeqi (Gao, Yeqi.) | Qiao, Tong (Qiao, Tong.) | Qi, Yingjie (Qi, Yingjie.) | Wang, Xiaoyi (Wang, Xiaoyi.) | Chen, Yunli (Chen, Yunli.) | Dai, Pengcheng (Dai, Pengcheng.) | Zhao, Weisheng (Zhao, Weisheng.) | Hu, Chunming (Hu, Chunming.)

Indexed by:

CPCI-S EI Scopus

Abstract:

Graph neural networks (GNN) have achieved state-of-the-art performance on various industrial tasks. However, the poor efficiency of GNN inference and frequent Out-Of-Memory (OOM) problem limit the successful application of GNN on edge computing platforms. To tackle these problems, a feature decomposition approach is proposed for memory efficiency optimization of GNN inference. The proposed approach could achieve outstanding optimization on various GNN models, covering a wide range of datasets, which speeds up the inference by up to 3x. Furthermore, the proposed feature decomposition could significantly reduce the peak memory usage (up to 5x in memory efficiency improvement) and mitigate OOM problems during GNN inference.

Keyword:

Graph Neural Network Memory Efficiency Feature Decomposition Edge Computing

Author Community:

  • [ 1 ] [Zhou, Ao]Beijing Univ Technol, Sch Software, Beijing, Peoples R China
  • [ 2 ] [Wang, Xiaoyi]Beijing Univ Technol, Sch Software, Beijing, Peoples R China
  • [ 3 ] [Chen, Yunli]Beijing Univ Technol, Sch Software, Beijing, Peoples R China
  • [ 4 ] [Zhou, Ao]Beihang Univ, Sch Comp Sci & Engn, Beijing, Peoples R China
  • [ 5 ] [Yang, Jianlei]Beihang Univ, Sch Comp Sci & Engn, Beijing, Peoples R China
  • [ 6 ] [Gao, Yeqi]Beihang Univ, Sch Comp Sci & Engn, Beijing, Peoples R China
  • [ 7 ] [Qiao, Tong]Beihang Univ, Sch Comp Sci & Engn, Beijing, Peoples R China
  • [ 8 ] [Qi, Yingjie]Beihang Univ, Sch Comp Sci & Engn, Beijing, Peoples R China
  • [ 9 ] [Hu, Chunming]Beihang Univ, Sch Comp Sci & Engn, Beijing, Peoples R China
  • [ 10 ] [Dai, Pengcheng]Beijing Bytedance Technol Co Ltd, Beijing, Peoples R China
  • [ 11 ] [Zhao, Weisheng]Beihang Univ, Sch Integrated Circuit Sci & Engn, Beijing, Peoples R China

Reprint Author's Address:

Show more details

Related Keywords:

Source :

2021 IEEE 27TH REAL-TIME AND EMBEDDED TECHNOLOGY AND APPLICATIONS SYMPOSIUM (RTAS 2021)

ISSN: 1545-3421

Year: 2021

Page: 445-448

Cited Count:

WoS CC Cited Count: 11

SCOPUS Cited Count: 13

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 7

Affiliated Colleges:

Online/Total:553/10582814
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.