Skip to main navigation Skip to search Skip to main content

Diff-Holo: A Residual Diffusion Model with Complex Transformer for Rapid Single-Frame Hologram Reconstruction

  • Faculty of Computing, Harbin Institute of Technology
  • Peng Cheng Laboratory
  • Tsinghua University

Research output: Contribution to journalArticlepeer-review

Abstract

Deep learning approaches have gained significant traction in holographic imaging, with diffusion models - an emerging class of deep generative models - showing particular promise in hologram reconstruction. Unlike conventional neural networks that directly generate outputs, diffusion models gradually add noise to data and train neural networks to remove it, enabling them to learn implicit priors of the underlying data distribution. However, current diffusion-based hologram reconstruction methods often require hundreds or even thousands of iterations to achieve high-fidelity results, leading to processing times of several minutes or more - falling short of the fast imaging demands of holographic systems. To address this, we propose Diff-Holo, a residual diffusion model integrated with a complex transformer, designed for rapid and high-quality single-frame hologram reconstruction. Specifically, we create a shorter and more efficient Markov chain by controlling the residuals between clean images and those degraded by twin-image artifacts. Additionally, we incorporate complex-valued priors into the network by using a complex window-based transformer as the backbone, enhancing the network's ability to process complex-valued data in the reverse reconstruction process. Experimental results demonstrate that Diff-Holo achieves high-quality single-frame reconstructions in as few as 15 sampling steps, reducing reconstruction time from minutes to under 2.2 seconds.

Original languageEnglish
Pages (from-to)689-703
Number of pages15
JournalIEEE Transactions on Computational Imaging
Volume11
DOIs
StatePublished - 2025
Externally publishedYes

Keywords

  • Single-frame hologram reconstruction
  • complex-valued deep neural network
  • rapid imaging
  • residual diffusion model
  • transformer

Fingerprint

Dive into the research topics of 'Diff-Holo: A Residual Diffusion Model with Complex Transformer for Rapid Single-Frame Hologram Reconstruction'. Together they form a unique fingerprint.

Cite this