TY - GEN
T1 - A novel method of combining computer vision, eye-tracking, EMG, and IMU to control dexterous prosthetic hand
AU - Shi, Chunyuan
AU - Qi, Le
AU - Yang, Dapeng
AU - Zhao, Jingdong
AU - Liu, Hong
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/12
Y1 - 2019/12
N2 - Due to poor robustness, instability, and the heavy burden of use, the traditional myoelectric control method is still powerless in the face of the control of the dexterous prosthetic hand. To solve this problem, a new method (CVEEI), that combines computer vision, eye tracking, electromyogram (EMG) and IMU was proposed in this paper. Firstly, through gazing (eye-tracking) in front of the screen, the grasping pattern of the objects can be fed back to the prosthetic hand controller; Then, the prosthetic hand can be controlled to transport the object to the position expected, on collaboration of both EMG and IMU. In this process, the grasping pattern of all objects can be recognized by computer vision in real-time. Importantly, through comparing the traditional EMG control method (co-contraction to switch) in the transport experiment of the objects, the superiority of this new method in operating the dexterous prosthetic hand was further verified (fast > 1s/single object) in this paper.
AB - Due to poor robustness, instability, and the heavy burden of use, the traditional myoelectric control method is still powerless in the face of the control of the dexterous prosthetic hand. To solve this problem, a new method (CVEEI), that combines computer vision, eye tracking, electromyogram (EMG) and IMU was proposed in this paper. Firstly, through gazing (eye-tracking) in front of the screen, the grasping pattern of the objects can be fed back to the prosthetic hand controller; Then, the prosthetic hand can be controlled to transport the object to the position expected, on collaboration of both EMG and IMU. In this process, the grasping pattern of all objects can be recognized by computer vision in real-time. Importantly, through comparing the traditional EMG control method (co-contraction to switch) in the transport experiment of the objects, the superiority of this new method in operating the dexterous prosthetic hand was further verified (fast > 1s/single object) in this paper.
KW - Computer vision
KW - EMG
KW - Eye tracking
KW - IMU
KW - Prosthetic hand
UR - https://www.scopus.com/pages/publications/85079046491
U2 - 10.1109/ROBIO49542.2019.8961582
DO - 10.1109/ROBIO49542.2019.8961582
M3 - 会议稿件
AN - SCOPUS:85079046491
T3 - IEEE International Conference on Robotics and Biomimetics, ROBIO 2019
SP - 2614
EP - 2618
BT - IEEE International Conference on Robotics and Biomimetics, ROBIO 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 IEEE International Conference on Robotics and Biomimetics, ROBIO 2019
Y2 - 6 December 2019 through 8 December 2019
ER -