• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Ying, Y. (Ying, Y..) | Wang, J. (Wang, J..) | Shi, Y. (Shi, Y..) | Ling, N. (Ling, N..) | Yin, B. (Yin, B..)

Indexed by:

EI Scopus SCIE

Abstract:

In the Coded Aperture Snapshot Spectral Imaging (CASSI) systems, hyperspectral images (HSIs) reconstruction methods are employed to recover 3D signals from 2D compressive measurements. Among these methods, deep unfolding networks exhibit the benefits of interpretability and high efficiency, but they still have some notable shortcomings. Firstly, existing methods primarily exploit the spatial-spectral domain information of HSIs, neglecting exploration of the frequency domain, which is also beneficial to 3D HSIs. Secondly, current unfolding networks have limited utilization of information between different stages, failing to fully explore their relevance and thereby limiting the effectiveness of the overall framework. To address these issues, in this paper, we propose an integrated framework with dual-domain feature fusion and multi-level memory enhancement. Specifically, the former represents the first attempt to utilize frequency domain information in the feature space of HSIs overcoming the limitation of spatial-spectral domain features and thereby improving the data expression ability of the network by extracting dual-domain features. Simultaneously, our verification experiments also show that the proposed dual-domain feature representation can indeed extract complementary feature information in HSIs. Moreover, the latter aims to use the structural characteristics of the U-Net network to fully extract the correlation of information between different stages by designing a multi-level memory enhancement network. Extensive experimental results on various datasets validate the superiority of the proposed approach in both subjective and objective outcomes. Our proposed method achieves an average of 0.4dB improvement over the best counterpart method. And the code can be obtained from the link: https://github.com/yingyangke/DFFMM. IEEE

Keyword:

Image coding Image reconstruction Deep Unfolding Network Task analysis Feature extraction Imaging Spectral Snapshot Compressive Imaging Frequency-domain analysis Compressive sensing Correlation

Author Community:

  • [ 1 ] [Ying Y.]Faculty of Information Technology, Beijing University of Technology, Beijing, China
  • [ 2 ] [Wang J.]Faculty of Information Technology, Beijing University of Technology, Beijing, China
  • [ 3 ] [Shi Y.]Faculty of Information Technology, Beijing University of Technology, Beijing, China
  • [ 4 ] [Ling N.]Department of Computer Science and Engineering, Santa Clara University, Santa Clara, California, USA
  • [ 5 ] [Yin B.]Faculty of Information Technology, Beijing University of Technology, Beijing, China

Reprint Author's Address:

Email:

Show more details

Related Keywords:

Source :

IEEE Transactions on Circuits and Systems for Video Technology

ISSN: 1051-8215

Year: 2024

Issue: 10

Volume: 34

Page: 1-1

8 . 4 0 0

JCR@2022

Cited Count:

WoS CC Cited Count:

SCOPUS Cited Count:

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 8

Affiliated Colleges:

Online/Total:968/10647119
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.