Skip to main navigation Skip to search Skip to main content

DexMP: Diffusion-Guided Motion Planning for Collision-Free Arm-Hand Manipulation in Cluttered Environments

  • Harbin Institute of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Dexterous manipulation in cluttered scenes is challenging due to the coupled constraints of arm kinematics, multi-finger hand posture, self-collision avoidance, and contact feasibility. Compared with gripper-based manipulation, arm-hand planning involves a significantly larger hybrid discrete-continuous search space, where unsuitable pre-grasp postures may invalidate otherwise feasible motions. This paper presents a two-stage arm-hand planning framework that combines a conditional diffusion model with optimization-based refinement to generate collision-free and dynamically feasible trajectories. The diffusion model is conditioned on the robot state, task goal, scene context, and discrete hand-pose priors to generate high-quality warm-start trajectories, which are subsequently refined by an Optimal Control Problem (OCP) solver under dynamics and collision constraints. We further compare Slot Attention and point-cloud encoding for scene representation, and experimental results show that point-cloud encoding better preserves clutter geometry and improves planning stability. A compact hand configuration library is additionally introduced to provide stable pre-grasp postures for dexterous execution. Experiments on cluttered shelf-like manipulation tasks demonstrate that the proposed method outperforms representative baselines in success rate, trajectory quality, and planning efficiency.

Original languageEnglish
Title of host publication2026 7th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2026
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages471-478
Number of pages8
ISBN (Electronic)9798319543776
DOIs
StatePublished - 2026
Event7th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2026 - Dalian, China
Duration: 15 May 202617 May 2026

Publication series

Name2026 7th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2026

Conference

Conference7th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2026
Country/TerritoryChina
CityDalian
Period15/05/2617/05/26

Keywords

  • Dexterous manipulation
  • Diffusion model
  • Motion planning

Fingerprint

Dive into the research topics of 'DexMP: Diffusion-Guided Motion Planning for Collision-Free Arm-Hand Manipulation in Cluttered Environments'. Together they form a unique fingerprint.

Cite this