Skip to main navigation Skip to search Skip to main content

Hierarchical Control Framework for Path Planning of Mobile Robots in Dynamic Environments Through Global Guidance and Reinforcement Learning

  • Hongyang Zhao
  • , Yanan Guo*
  • , Xingdong Li
  • , Yi Liu
  • , Jing Jin
  • *Corresponding author for this work
  • Northeast Forestry University
  • Harbin Institute of Technology

Research output: Contribution to journalArticlepeer-review

Abstract

—This article focuses on achieving efficient and safe navigation for robots in dynamic and unpredictable environments. We propose a hierarchical path planning framework that integrates global path planning with local dynamic obstacle avoidance. This framework aims to quickly plan a collision-free, shortest, and safest path for the robot while adapting the navigation path according to uncertainties in the operating environment. Global path planning is conducted using the improved gray wolf optimization algorithm (IGWO), trajectory tracking is achieved through a pure pursuit control algorithm, and a dynamic switching mechanism based on deep reinforcement learning (DRL) significantly enhances the navigation performance of the robotic system. The effectiveness of this approach has been verified through simulations and experiments. Simulation results indicate that in global path planning, the IGWO algorithm achieves faster convergence compared to algorithms, such as GWO-MP and GWO-CS. The planned path lengths are reduced by approximately 4.01% and 2.27%, respectively, and the fitness values are decreased by 4.78% and 1.9%, demonstrating superior path planning performance. For local dynamic obstacle avoidance, both single-robot and multirobot systems successfully avoided obstacles in multiple experiments. Finally, physical experiments conducted in various complex scenarios show that both single-robot and multirobot systems can effectively execute global planning and respond to unexpected obstacles. These results further demonstrate the method’s wide applicability and robust performance across diverse complex environments.

Original languageEnglish
Pages (from-to)309-333
Number of pages25
JournalIEEE Internet of Things Journal
Volume12
Issue number1
DOIs
StatePublished - 2025

Keywords

  • Gray wolf optimization
  • mobile robot
  • path planning
  • reinforcement learning

Fingerprint

Dive into the research topics of 'Hierarchical Control Framework for Path Planning of Mobile Robots in Dynamic Environments Through Global Guidance and Reinforcement Learning'. Together they form a unique fingerprint.

Cite this