Skip to main navigation Skip to search Skip to main content

Heterogeneous Feature Collaboration Network for Salient Object Detection in Optical Remote Sensing Images

  • Yutong Liu
  • , Mingzhu Xu*
  • , Tianxiang Xiao
  • , Haoyu Tang
  • , Yupeng Hu
  • , Liqiang Nie
  • *Corresponding author for this work
  • Shandong University
  • Harbin Institute of Technology

Research output: Contribution to journalArticlepeer-review

Abstract

In recent years, the task of salient object detection in optical remote sensing images (RSI-SOD) has gained increasing interest. Despite some advancement in current methods, challenges such as the irregular topology of salient objects and cluttered backgrounds in optical RSI remain. To tackle these issues, we propose a novel heterogeneous feature collaboration network (HFCNet). Specifically, we design a new hybrid heterogeneous encoder that combines CNN and transformer to extract a set of heterogeneous features, famous in modeling local and global information, respectively. Subsequently, the adaptive global-local integration (AGLI) module is devised to integrate these complementary heterogeneous features through our feature alignment methods at global and local levels, so the global irregular topology structure and local details can be well-modeled. Furthermore, the proposed saliency-guided attention enhanced decoder (SGAED) leverages deep salient cues to guide the shallow decoders to pay more attention to important areas and suppress irrelevant areas, reducing the interference of cluttered backgrounds. Extensive experiments on three benchmark datasets have confirmed the significant superiority of our method compared with 18 state-of-the-art methods. All codes and results of our method are available at https://github.com/xumingzhu989/HFCNet-TGRS.

Original languageEnglish
Article number5635114
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume62
DOIs
StatePublished - 2024
Externally publishedYes

Keywords

  • Attention mechanism
  • feature alignment
  • heterogeneous feature fusion
  • optical remote sensing images
  • salient object detection (SOD)

Fingerprint

Dive into the research topics of 'Heterogeneous Feature Collaboration Network for Salient Object Detection in Optical Remote Sensing Images'. Together they form a unique fingerprint.

Cite this