Skip to main navigation Skip to search Skip to main content

An Image Fusion Method Based on Special Residual Network and Efficient Channel Attention

  • Yang Li
  • , Haitao Yang
  • , Jinyu Wang
  • , Changgong Zhang
  • , Zhengjun Liu
  • , Hang Chen*
  • *Corresponding author for this work
  • Space Engineering University
  • School of Physics, Harbin Institute of Technology
  • Université de Lorraine

Research output: Contribution to journalArticlepeer-review

Abstract

This paper presents an image fusion network based on a special residual network and attention mechanism. Compared with the traditional fusion network, the image fusion network has the advantages of an end-to-end network and integrates the feature extraction advantages of the attention mechanism residual network. It overcomes the shortcomings of the traditional network that need complex design rules and manual operation. In this method, hierarchical feature fusion is used to achieve effective fusion. A combined loss function is designed to optimize training results and improve image fusion quality. This paper uses many qualitative and quantitative experimental analyses on different data sets. The results show that, compared with the comparison algorithm, the method in this paper has a stronger retention ability of infrared and visible light information and better indexes. 72% of eleven indexes compared with some images in the public TNO data set are optimal or sub-optimal, and 80% are optimal or suboptimal in the RoadScene data set, which is much higher than other algorithms. The overall fusion effect is more in line with human visual perception.

Original languageEnglish
Article number3140
JournalElectronics (Switzerland)
Volume11
Issue number19
DOIs
StatePublished - Oct 2022
Externally publishedYes

Keywords

  • attention mechanism
  • codec network
  • deep learning
  • image fusion

Fingerprint

Dive into the research topics of 'An Image Fusion Method Based on Special Residual Network and Efficient Channel Attention'. Together they form a unique fingerprint.

Cite this