• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Fang, L. (Fang, L..) | Xiang, W. (Xiang, W..) | Zhou, Y. (Zhou, Y..) | Fang, J. (Fang, J..) | Chi, L. (Chi, L..) | Ge, Z. (Ge, Z..)

Indexed by:

EI Scopus SCIE

Abstract:

In real-world scenarios, partial information losses of multivariate time series degrade the time series analysis. Hence, the time series imputation technique has been adopted to compensate for the missing values. Existing methods focus on investigating temporal correlations, cross-variable correlations, and bidirectional dynamics of time series, and most of these methods rely on recurrent neural networks (RNNs) to capture temporal dependency. However, the RNN-based models suffer from the common problems of slow speed and high complexity when dealing with long-term dependency. While some self-attention-based models without any recurrent structures can tackle long-term dependency with parallel computing, they do not fully learn and utilize correlations across the temporal and cross-variable dimensions. To address the limitations of existing methods, we propose a novel so-called dual-branch cross-dimensional self-attention-based imputation (DCSAI) model for multivariate time series, which is capable of performing global and auxiliary cross-dimensional analyses when imputing the missing values. In particular, this model contains masked multi-head self-attention-based encoders aligned with auxiliary generators to obtain global and auxiliary correlations in two dimensions, and these correlations are then combined into one final representation through three weighted combinations. Extensive experiments are presented to show that our model performs better than other state-of-the-art benchmarkers on three real-world public datasets under various missing rates. Furthermore, ablation study results demonstrate the efficacy of each component of the model. © 2023 The Authors

Keyword:

Missing value imputation Multivariate time series Self-attention Deep learning

Author Community:

  • [ 1 ] [Fang L.]School of Electrical and Information Engineering, Tianjin University, Tianjin, China
  • [ 2 ] [Xiang W.]School of Computing, Engineering and Mathematical Sciences, La Trobe University, Melbourne, 3086, Australia
  • [ 3 ] [Zhou Y.]School of Electrical and Information Engineering, Tianjin University, Tianjin, China
  • [ 4 ] [Fang J.]Faculty of Information Technology, Beijing University of Technology, Beijing, China
  • [ 5 ] [Chi L.]School of Computing, Engineering and Mathematical Sciences, La Trobe University, Melbourne, 3086, Australia
  • [ 6 ] [Ge Z.]Faculty of IT, Monash Medical AI, Monash-Airdoc Research Lab, Monash University, Victoria, 3800, Australia

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

Knowledge-Based Systems

ISSN: 0950-7051

Year: 2023

Volume: 279

8 . 8 0 0

JCR@2022

ESI Discipline: COMPUTER SCIENCE;

ESI HC Threshold:19

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count: 4

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 5

Affiliated Colleges:

Online/Total:727/10590257
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.