TDPN: Texture and Detail-Preserving Network for Single Image Super-Resolution

  • Qing Cai
  • , Jinxing Li*
  • , Huafeng Li
  • , Yee Hong Yang
  • , Feng Wu
  • , David Zhang*
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Single image super-resolution (SISR) using deep convolutional neural networks (CNNs) achieves the state-of-the-art performance. Most existing SISR models mainly focus on pursuing high peak signal-to-noise ratio (PSNR) and neglect textures and details. As a result, the recovered images are often perceptually unpleasant. To address this issue, in this paper, we propose a texture and detail-preserving network (TDPN), which focuses not only on local region feature recovery but also on preserving textures and details. Specifically, the high-resolution image is recovered from its corresponding low-resolution input in two branches. First, a multi-reception field based branch is designed to let the network fully learn local region features by adaptively selecting local region features in different reception fields. Then, a texture and detail-learning branch supervised by the textures and details decomposed from the ground-truth high resolution image is proposed to provide additional textures and details for the super-resolution process to improve the perceptual quality. Finally, we introduce a gradient loss into the SISR field and define a novel hybrid loss to strengthen boundary information recovery and to avoid overly smooth boundary in the final recovered high-resolution image caused by using only the MAE loss. More importantly, the proposed method is model-agnostic, which can be applied to most off-the-shelf SISR networks. The experimental results on public datasets demonstrate the superiority of our TDPN on most state-of-the-art SISR methods in PSNR, SSIM and perceptual quality. We will share our code on https://github.com/tocaiqing/TDPN.

Original languageEnglish
Pages (from-to)2375-2389
Number of pages15
JournalIEEE Transactions on Image Processing
Volume31
DOIs
StatePublished - 2022
Externally publishedYes

Keywords

  • Single image super-resolution (SISR)
  • convolutional neural network (CNN)
  • multi-branch network
  • multi-reception field module
  • texture and detail-preserving network (TDPN)

Fingerprint

Dive into the research topics of 'TDPN: Texture and Detail-Preserving Network for Single Image Super-Resolution'. Together they form a unique fingerprint.

Cite this