Skip to main navigation Skip to search Skip to main content

Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service

  • Kuiyuan Zhang
  • , Zhongyun Hua*
  • , Yuanman Li
  • , Yushu Zhang
  • , Yicong Zhou
  • *Corresponding author for this work
  • School of Computer Science and Technology, Harbin Institute of Technology
  • Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies
  • Shenzhen University
  • Nanjing University of Aeronautics and Astronautics
  • University of Macau

Research output: Contribution to journalArticlepeer-review

Abstract

Many service computing applications require real-time dataset collection from multiple devices, necessitating efficient sampling techniques to reduce bandwidth and storage pressure. Compressive sensing (CS) has found wide-ranging applications in image acquisition and reconstruction. Recently, numerous deep-learning methods have been introduced for CS tasks. However, the accurate reconstruction of images from measurements remains a significant challenge, especially at low sampling rates. In this article, we propose Uformer-ICS as a novel U-shaped transformer for image CS tasks by introducing inner characteristics of CS into transformer architecture. To utilize the uneven sparsity distribution of image blocks, we design an adaptive sampling architecture that allocates measurement resources based on the estimated block sparsity, allowing the compressed results to retain maximum information from the original image. Additionally, we introduce a multi-channel projection (MCP) module inspired by traditional CS optimization methods. By integrating the MCP module into the transformer blocks, we construct projection-based transformer blocks, and then form a symmetrical reconstruction model using these blocks and residual convolutional blocks. Therefore, our reconstruction model can simultaneously utilize the local features and long-range dependencies of image, and the prior projection knowledge of CS theory. Experimental results demonstrate its significantly better reconstruction performance than state-of-the-art deep learning-based CS methods.

Original languageEnglish
Pages (from-to)2974-2988
Number of pages15
JournalIEEE Transactions on Services Computing
Volume17
Issue number5
DOIs
StatePublished - 2024
Externally publishedYes

Keywords

  • Compressive sensing service
  • adaptive sampling
  • compressive sampling
  • deep learning
  • image reconstruction

Fingerprint

Dive into the research topics of 'Uformer-ICS: A U-Shaped Transformer for Image Compressive Sensing Service'. Together they form a unique fingerprint.

Cite this