Skip to main navigation Skip to search Skip to main content

The Prosthetic Hand Can Grasp Occluded Objects with the Help of 3rd-Eye Based on Artificial Vision and AR Technology

  • Harbin Institute of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Grasping occluded objects is a large challenge for hand amputees because of the hand's perception loss. This paper proposed an alternative approach based on artificial vision and augmented reality technology, termed 3rd-Eye, to solve the problem. In detail, a live stream of an RGB camera attached to the prosthetic hand was presented to the user who wore an augmented reality helmet, HoloLens 2. The 3rd-Eye was integrated into a hybrid control prosthetic system (i-MYO proposed in our previous work). It was tested in a special reach-And-grasp experiment where the subject needed to grasp an occluded object in cluttered environments (one to six objects in total) using the prosthetic hand. The new approach has achieved satisfactory results (success rate: 100% in all).

Original languageEnglish
Title of host publicationArtificial Intelligence and Human-Computer Interaction - Proceedings of the 1st International Conference, ArtInHCI 2023
EditorsYalan Ye, Patrick Siarry
PublisherIOS Press BV
Pages306-313
Number of pages8
ISBN (Electronic)9781643685083
DOIs
StatePublished - 18 Mar 2024
Event1st International Conference on Artificial Intelligence and Human-Computer Interaction, ArtInHCI 2023 - Virtual, Online, China
Duration: 27 Oct 202329 Oct 2023

Publication series

NameFrontiers in Artificial Intelligence and Applications
Volume385
ISSN (Print)0922-6389
ISSN (Electronic)1879-8314

Conference

Conference1st International Conference on Artificial Intelligence and Human-Computer Interaction, ArtInHCI 2023
Country/TerritoryChina
CityVirtual, Online
Period27/10/2329/10/23

Keywords

  • Prosthetic hand
  • augmented reality
  • computer vision

Fingerprint

Dive into the research topics of 'The Prosthetic Hand Can Grasp Occluded Objects with the Help of 3rd-Eye Based on Artificial Vision and AR Technology'. Together they form a unique fingerprint.

Cite this