• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Fang, Le (Fang, Le.) | Xiang, Wei (Xiang, Wei.) | Zhou, Yuan (Zhou, Yuan.) | Fang, Juan (Fang, Juan.) | Chi, Lianhua (Chi, Lianhua.) | Ge, Zongyuan (Ge, Zongyuan.)

Indexed by:

EI Scopus SCIE

Abstract:

In real-world scenarios, partial information losses of multivariate time series degrade the time series analysis. Hence, the time series imputation technique has been adopted to compensate for the missing values. Existing methods focus on investigating temporal correlations, cross-variable correlations, and bidirectional dynamics of time series, and most of these methods rely on recurrent neural networks (RNNs) to capture temporal dependency. However, the RNN-based models suffer from the common problems of slow speed and high complexity when dealing with long-term dependency. While some self-attention-based models without any recurrent structures can tackle long-term dependency with parallel computing, they do not fully learn and utilize correlations across the temporal and cross variable dimensions. To address the limitations of existing methods, we propose a novel so-called dual-branch cross-dimensional self-attention-based imputation (DCSAI) model for multivariate time series, which is capable of performing global and auxiliary cross-dimensional analyses when imputing the missing values. In particular, this model contains masked multi-head self-attention-based encoders aligned with auxiliary generators to obtain global and auxiliary correlations in two dimensions, and these correlations are then combined into one final representation through three weighted combinations. Extensive experiments are presented to show that our model performs better than other state-of-the-art benchmarkers on three real-world public datasets under various missing rates. Furthermore, ablation study results demonstrate the efficacy of each component of the model.(c) 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).

Keyword:

Deep learning Self-attention Multivariate time series Missing value imputation

Author Community:

  • [ 1 ] [Fang, Le]Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
  • [ 2 ] [Zhou, Yuan]Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
  • [ 3 ] [Xiang, Wei]La Trobe Univ, Sch Comp Engn & Math Sci, Melbourne 3086, Australia
  • [ 4 ] [Chi, Lianhua]La Trobe Univ, Sch Comp Engn & Math Sci, Melbourne 3086, Australia
  • [ 5 ] [Fang, Juan]Beijing Univ Technol, Fac Informat Technol, Beijing, Peoples R China
  • [ 6 ] [Ge, Zongyuan]Monash Univ, Fac IT, Monash Airdoc Res Lab, Monash Med AI, Melbourne, Vic 3800, Australia

Reprint Author's Address:

Show more details

Related Keywords:

Source :

KNOWLEDGE-BASED SYSTEMS

ISSN: 0950-7051

Year: 2023

Volume: 279

8 . 8 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 0

Affiliated Colleges:

Online/Total:1526/10901564
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.