Skip to main navigation Skip to search Skip to main content

Frustumpillar-Fusion: Gated 4D Radar-Camera Fusion for USVs

  • Haoyu Zheng
  • , Hongbo Li
  • , Hongliang Song
  • , Haibin Huang
  • , Yu Chen
  • , Wei Ding
  • , Xiaoyi Ma
  • , Xinxin Zhou
  • Harbin Institute of Technology Weihai
  • Huaneng Lancang River Hydropower Inc

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Robust object detection for Unmanned Surface Vehicles (USVs) in inland waterways remains challenging due to projection-induced depth collapse and Doppler cancellation in radar-camera fusion. We propose FrustumPillar-Fusion, an end-to-end 4D radar-camera detector that removes explicit radar-to-image projection. A Frustum Pillar Encoder performs ray-aligned 3D partition to preserve geometric and Doppler cues, while a Radar-Gated Fusion Module uses a pixel-wise map α and a global scalar β to decouple spatial blending from residual refinement. On WaterScenes, our method achieves 65.0 mAP50-95 and 91.3 mAP50, outperforming listed baselines under our current benchmark setting and showing stronger robustness in challenging scenes. These results indicate that preserving frustum-aligned radar structure before cross-modal interaction is essential for reducing early feature contamination. The proposed design further provides a practical radar-camera fusion strategy for safety-critical USV perception in complex inland waterways.

Original languageEnglish
Title of host publicationOCEANS 2026 Sanya, OCEANS 2026
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798319543646
DOIs
StatePublished - 2026
Externally publishedYes
EventOCEANS 2026 Sanya, OCEANS 2026 - Sanya, China
Duration: 25 May 202628 May 2026

Publication series

NameOceans Conference Record (IEEE)
ISSN (Print)0197-7385

Conference

ConferenceOCEANS 2026 Sanya, OCEANS 2026
Country/TerritoryChina
CitySanya
Period25/05/2628/05/26

Keywords

  • Frustum Pillar
  • Inland Waterways
  • Multi-modal Fusion
  • Unmanned Surface Vehicle

Fingerprint

Dive into the research topics of 'Frustumpillar-Fusion: Gated 4D Radar-Camera Fusion for USVs'. Together they form a unique fingerprint.

Cite this