Skip to main navigation Skip to search Skip to main content

Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition

  • Longkun Zou
  • , Kangjun Liu
  • , Ke Chen*
  • , Kailing Guo
  • , Kui Jia
  • , Yaowei Wang
  • *Corresponding author for this work
  • Pengcheng Laboratory
  • South China University of Technology
  • The Chinese University of Hong Kong, Shenzhen
  • Harbin Institute of Technology Shenzhen

Research output: Contribution to journalArticlepeer-review

Abstract

Learning semantic representations from point sets of 3D object shapes is often challenged by significant geometric variations, primarily due to differences in data acquisition methods. Typically, training data is generated using point simulators, while testing data is collected with distinct 3D sensors, leading to a simulation-to-reality (Sim2Real) domain gap that limits the generalization ability of point classifiers. Current unsupervised domain adaptation (UDA) techniques struggle with this gap, as they often lack robust, domain-insensitive descriptors capable of capturing global topological information, resulting in overfitting to the limited semantic patterns of the source domain. To address this issue, we introduce a novel Topology-Aware Modeling (TAM) framework for Sim2Real UDA on object point clouds. Our approach mitigates the domain gap by leveraging global spatial topology, characterized by low-level, high-frequency 3D structures, and by modeling the topological relations of local geometric features through a novel self-supervised learning task. Additionally, we propose an advanced self-training strategy that combines cross-domain contrastive learning with self-training, effectively reducing the impact of noisy pseudo-labels and enhancing the robustness of the adaptation process. Experimental results on three public Sim2Real benchmarks validate the effectiveness of our TAM framework, showing consistent improvements over state-of-the-art methods across all evaluated tasks.

Original languageEnglish
Pages (from-to)181-195
Number of pages15
JournalIEEE Transactions on Multimedia
Volume28
DOIs
StatePublished - 2026
Externally publishedYes

Keywords

  • Unsupervised domain adaptation
  • contrastive learning
  • point clouds
  • self-training
  • simulation-to-reality

Fingerprint

Dive into the research topics of 'Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition'. Together they form a unique fingerprint.

Cite this