• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
搜索

Author:

Sun, Yichen (Sun, Yichen.) | Dong, Mingli (Dong, Mingli.) | Yu, Mingxin (Yu, Mingxin.) | Zhu, Lianqing (Zhu, Lianqing.)

Indexed by:

EI Scopus SCIE

Abstract:

Fusing infrared and visible imagery aims to harness their complementary spectral data, enhancing output image quality, sharpness, and content. However, convolutional neural networks (CNNs) are not capable of capturing long-range dependencies, while the Transformer architecture faces the challenge of consuming huge computational resources. To address these critical challenges, this paper proposes a novel framework named MBHFuse, which employs a multi-branch heterogeneous global and local image fusion approach. To effectively extract global and local features, we design a multi-branch heterogeneous encoder module and introduce a differential convolution amplification module (DCAM) to further extract complementary information. Additionally, we devise a new loss function, incorporating multi-branch feature decomposition loss, intensity loss, gradient loss, mean squared error loss, and structural similarity loss, for training the proposed MBHFuse model. Through extensive experiments on public datasets, we demonstrate that the proposed framework outperforms other stateof-the-art (SOTA) methods in both qualitative and quantitative evaluations. Our code will be available at htt ps://github.com/sunyichen1994/MBHFuse.

Keyword:

Image fusion Transformer Infrared fusion Heterogeneous network Deep learning

Author Community:

  • [ 1 ] [Sun, Yichen]Beijing Univ Technol, Coll Mech & Energy Engn, Beijing 100124, Peoples R China
  • [ 2 ] [Dong, Mingli]Beijing Univ Technol, Coll Mech & Energy Engn, Beijing 100124, Peoples R China
  • [ 3 ] [Sun, Yichen]Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100192, Peoples R China
  • [ 4 ] [Dong, Mingli]Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100192, Peoples R China
  • [ 5 ] [Yu, Mingxin]Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100192, Peoples R China
  • [ 6 ] [Zhu, Lianqing]Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100192, Peoples R China
  • [ 7 ] [Sun, Yichen]Guangzhou Nansha Intelligent Photon Sensing Res In, Guangzhou 511462, Peoples R China
  • [ 8 ] [Dong, Mingli]Guangzhou Nansha Intelligent Photon Sensing Res In, Guangzhou 511462, Peoples R China
  • [ 9 ] [Yu, Mingxin]Guangzhou Nansha Intelligent Photon Sensing Res In, Guangzhou 511462, Peoples R China
  • [ 10 ] [Zhu, Lianqing]Guangzhou Nansha Intelligent Photon Sensing Res In, Guangzhou 511462, Peoples R China

Reprint Author's Address:

  • [Zhu, Lianqing]Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100192, Peoples R China;;

Show more details

Related Keywords:

Related Article:

Source :

OPTICS AND LASER TECHNOLOGY

ISSN: 0030-3992

Year: 2024

Volume: 181

5 . 0 0 0

JCR@2022

Cited Count:

WoS CC Cited Count: 3

SCOPUS Cited Count: 3

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 6

Affiliated Colleges:

Online/Total:533/10713074
Address:BJUT Library(100 Pingleyuan,Chaoyang District,Beijing 100124, China Post Code:100124) Contact Us:010-67392185
Copyright:BJUT Library Technical Support:Beijing Aegean Software Co., Ltd.