Skip to main navigation Skip to search Skip to main content

MPS2L: Mutual Prediction Self-Supervised Learning for Remote Sensing Image Change Detection

  • Qingwang Wang
  • , Yujie Qiu
  • , Pengcheng Jin
  • , Tao Shen*
  • , Yanfeng Gu
  • *Corresponding author for this work
  • Kunming University of Science and Technology
  • School of Electronics and Information Engineering, Harbin Institute of Technology
  • Heilongjiang Province Key Laboratory of Space-Air-Ground Integrated Intelligent Remote Sensing

Research output: Contribution to journalArticlepeer-review

Abstract

In this article, we propose a novel mutual prediction self-supervised learning (MPS2L) method for remote sensing (RS) image change detection (CD). Compared with the previous self-supervised CD methods based on contrastive learning (CL), MPS2L employing a pixel-level training strategy based on masked image modeling (MIM) can effectively train the model to interpret the local scene of RS images. Utilizing global and local scenes and temporal change features extracted from masked bitemporal images to achieve cross-temporal mutual prediction makes the model have the ability to understand the overall observation scene and capture the change information. The training of the two abilities is carried out simultaneously, avoiding the problem of multiobjective conflict or mutual inhibition. To better focus on the changing regions in RS scenes, we further introduce a change feature interaction module (CFIM), comprising spatial and channel feature interaction. The channel interaction module (CIM) can facilitate the cross-temporal transmission of global scene information by channel attention, and the spatial interaction module (SIM) can promote the network to capture information on changing regions by spatial attention. The experimental results on three benchmark RS CD datasets demonstrate the effectiveness and priority of our proposed MPS2L compared to some existing state-of-the-art (SOTA) methods. The source code of the proposed MPS2L will be made available publicly at https://github.com/KustTeamWQW/MPS2L.

Original languageEnglish
Article number4414813
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume62
DOIs
StatePublished - 2024
Externally publishedYes

Keywords

  • Attention mechanism
  • masked image modeling (MIM)
  • remote sensing (RS) image change detection (CD)
  • self-supervised learning

Fingerprint

Dive into the research topics of 'MPS2L: Mutual Prediction Self-Supervised Learning for Remote Sensing Image Change Detection'. Together they form a unique fingerprint.

Cite this