Skip to main navigation Skip to search Skip to main content

MLTDNet: an efficient multi-level transformer network for single image deraining

  • Feng Gao
  • , Xiangyu Mu*
  • , Chao Ouyang
  • , Kai Yang
  • , Shengchang Ji
  • , Jie Guo
  • , Haokun Wei
  • , Nan Wang
  • , Lei Ma
  • , Biao Yang
  • *Corresponding author for this work
  • Xi'an Jiaotong University
  • State Grid Shaanxi Electric Power Research Institute
  • Harbin Institute of Technology Shenzhen
  • Ltd.
  • School of Architecture, Harbin Institute of Technology Shenzhen

Research output: Contribution to journalArticlepeer-review

Abstract

Single image rain streaks removal is a great challenging task in computer vision due to the uncertainty of the shape and size of rain streaks. Current methods attempted to adopt complex optimization processes or progressive refinement schemes. But these methods cause a significant impact on the efficiency of many real-time demanding applications. To address this problem, we propose a multi-level transformer deraining network which is an efficient single image rain removal model. Specifically, an efficient deraining network is constructed to extract rain streaks. We then employ cascade networks to extract feature information from deep high-level to shallow low-level layers. In addition, the multi-head self-attention mechanism is applied to extracting global information in the feature map at each level, which can highly improve the representational ability for rain streaks. Experimental results on both synthetic and real-world datasets have demonstrated the efficacy of our method, which uses less time costs and obtains comparable results in comparison to the state-of-the-art methods.

Original languageEnglish
Pages (from-to)14013-14027
Number of pages15
JournalNeural Computing and Applications
Volume34
Issue number16
DOIs
StatePublished - Aug 2022
Externally publishedYes

Keywords

  • Feature fusion
  • Multi-level
  • Rain streaks removal
  • Self-attention

Fingerprint

Dive into the research topics of 'MLTDNet: an efficient multi-level transformer network for single image deraining'. Together they form a unique fingerprint.

Cite this