TY - GEN
T1 - DexMP
T2 - 7th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2026
AU - Xie, Guanghu
AU - Li, Mingxu
AU - Zhang, Shuo
AU - Zhang, Yonglong
AU - Yang, Yifan
AU - Liu, Yang
AU - Xie, Zongwu
AU - Cao, Baoshi
N1 - Publisher Copyright:
© 2026 IEEE.
PY - 2026
Y1 - 2026
N2 - Dexterous manipulation in cluttered scenes is challenging due to the coupled constraints of arm kinematics, multi-finger hand posture, self-collision avoidance, and contact feasibility. Compared with gripper-based manipulation, arm-hand planning involves a significantly larger hybrid discrete-continuous search space, where unsuitable pre-grasp postures may invalidate otherwise feasible motions. This paper presents a two-stage arm-hand planning framework that combines a conditional diffusion model with optimization-based refinement to generate collision-free and dynamically feasible trajectories. The diffusion model is conditioned on the robot state, task goal, scene context, and discrete hand-pose priors to generate high-quality warm-start trajectories, which are subsequently refined by an Optimal Control Problem (OCP) solver under dynamics and collision constraints. We further compare Slot Attention and point-cloud encoding for scene representation, and experimental results show that point-cloud encoding better preserves clutter geometry and improves planning stability. A compact hand configuration library is additionally introduced to provide stable pre-grasp postures for dexterous execution. Experiments on cluttered shelf-like manipulation tasks demonstrate that the proposed method outperforms representative baselines in success rate, trajectory quality, and planning efficiency.
AB - Dexterous manipulation in cluttered scenes is challenging due to the coupled constraints of arm kinematics, multi-finger hand posture, self-collision avoidance, and contact feasibility. Compared with gripper-based manipulation, arm-hand planning involves a significantly larger hybrid discrete-continuous search space, where unsuitable pre-grasp postures may invalidate otherwise feasible motions. This paper presents a two-stage arm-hand planning framework that combines a conditional diffusion model with optimization-based refinement to generate collision-free and dynamically feasible trajectories. The diffusion model is conditioned on the robot state, task goal, scene context, and discrete hand-pose priors to generate high-quality warm-start trajectories, which are subsequently refined by an Optimal Control Problem (OCP) solver under dynamics and collision constraints. We further compare Slot Attention and point-cloud encoding for scene representation, and experimental results show that point-cloud encoding better preserves clutter geometry and improves planning stability. A compact hand configuration library is additionally introduced to provide stable pre-grasp postures for dexterous execution. Experiments on cluttered shelf-like manipulation tasks demonstrate that the proposed method outperforms representative baselines in success rate, trajectory quality, and planning efficiency.
KW - Dexterous manipulation
KW - Diffusion model
KW - Motion planning
UR - https://www.scopus.com/pages/publications/105043737050
U2 - 10.1109/AINIT70033.2026.11557990
DO - 10.1109/AINIT70033.2026.11557990
M3 - 会议稿件
AN - SCOPUS:105043737050
T3 - 2026 7th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2026
SP - 471
EP - 478
BT - 2026 7th International Seminar on Artificial Intelligence, Networking and Information Technology, AINIT 2026
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 15 May 2026 through 17 May 2026
ER -