Skip to main navigation Skip to search Skip to main content

Frequency-Phase Aware Mamba Fusion for Multiscale Spatial Representation in Remote Sensing Image Interpretation

  • Xinyue Liu
  • , Hongning Liu
  • , Mingjie Xie
  • , Dongli Xu
  • , Xianchao Zhang
  • , Pengming Feng
  • , Jian Guan*
  • *Corresponding author for this work
  • Dalian University of Technology
  • Beihang University
  • Shanghai Academy of AI for Science
  • CAST
  • College of Computer Science and Technology, Harbin Engineering University

Research output: Contribution to journalArticlepeer-review

Abstract

Remote sensing images (RSIs) exhibit complex spatial patterns due to diverse object scales, orientations, and distributions. These characteristics pose significant challenges for accurate interpretation. While existing methods focus on spatial feature extraction or rotational constraints, they often overlook the intrinsic relationship between frequency-phase information and spatial structures, which is critical for precise localization and classification. In this article, we propose a generic and flexible feature fusion framework, called phase-aware Mamba fusion mechanism (PMFM), which jointly captures frequency-phase patterns and global spatial dependencies. PMFM consists of two core modules, i.e., frequency-phase position encoding (PhasePE), which enhances positional encoding by embedding frequency-phase cues, and cross-attention-Mamba progressive fusion (CaMPF), which integrates global-local information across multiscale feature maps using cross-attention and vision Mamba. Furthermore, we design a PMFM-based feature pyramid architecture (PMFM-FPN) via a cross-scale concatenation strategy, enabling seamless integration into various detection and segmentation frameworks. Extensive experiments on five public RSI benchmarks (DOTA, DIOR-R, SISP, ISPRS Potsdam, and Vaihingen) across three major tasks, i.e., horizontal detection, oriented detection, and semantic segmentation, demonstrate that PMFM consistently improves performance and achieves competitive accuracy and robustness. In addition, an auxiliary experiment on ExDark further explores the behavior of phase-aware representations under general low-light visual conditions.

Original languageEnglish
Article number5627518
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume64
DOIs
StatePublished - 2026
Externally publishedYes

Keywords

  • Feature fusion
  • frequency-phase modeling
  • object detection
  • remote sensing image (RSI) interpretation
  • semantic segmentation
  • vision Mamba

Fingerprint

Dive into the research topics of 'Frequency-Phase Aware Mamba Fusion for Multiscale Spatial Representation in Remote Sensing Image Interpretation'. Together they form a unique fingerprint.

Cite this