Skip to main navigation Skip to search Skip to main content

Deep Unfolding 3D Non-Local Transformer Network for Hyperspectral Snapshot Compressive Imaging

  • Zheng Zhou
  • , Zongxin Liu
  • , Yongyong Chen
  • , Bingzhi Chen*
  • , Biqing Zeng
  • , Yicong Zhou
  • *Corresponding author for this work
  • Guangzhou University
  • South China Normal University
  • School of Computer Science and Technology, Harbin Institute of Technology
  • University of Macau

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Hyperspectral compressive imaging has shown remarkable advancements through the adoption of deep unfolding frameworks, which integrate the proximal mapping prior into the data fidelity term to formulate the reconstruction problem. However, existing technologies still face challenges in effectively capturing spatial-spectral features during the iterative deep prior learning stage, leading to unsatisfactory performance degradation. To address this issue, we propose a deep unfolding 3D non-local transformer (3DNLT) network for hyperspectral compressive imaging. A learnable half-quadratic splitting (HQS) algorithm is utilized to iteratively update the linear projection. Furthermore, a 3D non-local attention ushaped transformer is presented as the deep proximal mapping prior module to obtain the spatial-spectral long-range dependency features, leading to enhance the network's ability to capture fine-grained hyperspectral and spatial details. Experimental results on both synthetic and real hyperspectral image reconstruction have demonstrated the superior performance of the 3DNLT network compared to state-of-the-art methods.

Original languageEnglish
Title of host publication2024 IEEE International Conference on Multimedia and Expo, ICME 2024
PublisherIEEE Computer Society
ISBN (Electronic)9798350390155
DOIs
StatePublished - 2024
Externally publishedYes
Event2024 IEEE International Conference on Multimedia and Expo, ICME 2024 - Niagra Falls, Canada
Duration: 15 Jul 202419 Jul 2024

Publication series

NameProceedings - IEEE International Conference on Multimedia and Expo
ISSN (Print)1945-7871
ISSN (Electronic)1945-788X

Conference

Conference2024 IEEE International Conference on Multimedia and Expo, ICME 2024
Country/TerritoryCanada
CityNiagra Falls
Period15/07/2419/07/24

Keywords

  • Deep unfolding
  • hyperspectral snapshot compressive imaging
  • non-local mechanism
  • transformer

Fingerprint

Dive into the research topics of 'Deep Unfolding 3D Non-Local Transformer Network for Hyperspectral Snapshot Compressive Imaging'. Together they form a unique fingerprint.

Cite this