An Enhanced Hybrid Visual–Inertial Odometry System for Indoor Mobile Robot

As mobile robots are being widely used, accurate localization of the robot counts for the system. Compared with position systems with a single sensor, multi‐sensor fusion systems provide better performance and increase the accuracy and robustness. At present, camera and IMU (Inertial Measurement Unit) fusion positioning is extensively studied and many representative Visu-al–Inertial Odometry (VIO) systems have been produced. Multi‐State Constraint Kalman Filter (MSCKF), one of the tightly coupled filtering methods, is characterized by high accuracy and low computational load among typical VIO methods. In the general framework, IMU information is not used after predicting the state and covariance propagation. In this article, we proposed a framework which introduce IMU pre‐integration result into MSCKF framework as observation information to improve the system positioning accuracy. Additionally, the system uses the Helmert variance component estimation (HVCE) method to adjust the weight between feature points and pre‐integration to further improve the positioning accuracy. Similarly, this article uses the wheel odometer information of the mobile robot to perform zero speed detection, zero‐speed update, and pre‐integration update to enhance the positioning accuracy of the system. Finally, after experi-ments carried out in Gazebo simulation environment, public dataset and real scenarios, it is proved that the proposed algorithm has better accuracy results while ensuring real‐time performance than existing mainstream algorithms.