Skip to main navigation Skip to search Skip to main content

SIRA-PCR: Sim-to-Real Adaptation for 3D Point Cloud Registration

  • Suyi Chen
  • , Hao Xu
  • , Ru Li
  • , Guanghui Liu*
  • , Chi Wing Fu
  • , Shuaicheng Liu*
  • *Corresponding author for this work
  • University of Electronic Science and Technology of China
  • Megvii Technology Limited
  • Chinese University of Hong Kong
  • Institute of Medical Intelligence and Xr (IMIXR)

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Point cloud registration is essential for many applications. However, existing real datasets require extremely tedious and costly annotations, yet may not provide accurate camera poses. For the synthetic datasets, they are mainly object-level, so the trained models may not generalize well to real scenes. We design SIRA-PCR, a new approach to 3D point cloud registration. First, we build a synthetic scene-level 3D registration dataset, specifically designed with physically-based and random strategies to arrange diverse objects. Second, we account for variations in different sensing mechanisms and layout placements, then formulate a sim-to-real adaptation framework with an adaptive re-sample module to simulate patterns in real point clouds. To our best knowledge, this is the first work that explores sim-to-real adaptation for point cloud registration. Extensive experiments show the SOTA performance of SIRA-PCR on widely-used indoor and out-door datasets. The code and dataset will be released on https://github.com/Chen-Suyi/SIRA-Pytorc.h

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE/CVF International Conference on Computer Vision, ICCV 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages14348-14359
Number of pages12
ISBN (Electronic)9798350307184
DOIs
StatePublished - 2023
Event2023 IEEE/CVF International Conference on Computer Vision, ICCV 2023 - Paris, France
Duration: 2 Oct 20236 Oct 2023

Publication series

NameProceedings of the IEEE International Conference on Computer Vision
ISSN (Print)1550-5499

Conference

Conference2023 IEEE/CVF International Conference on Computer Vision, ICCV 2023
Country/TerritoryFrance
CityParis
Period2/10/236/10/23

Fingerprint

Dive into the research topics of 'SIRA-PCR: Sim-to-Real Adaptation for 3D Point Cloud Registration'. Together they form a unique fingerprint.

Cite this