Skip to main navigation Skip to search Skip to main content

Interact with robot: An efficient approach based on finite state machine and mouse gesture recognition

  • Harbin Institute of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Communication between human operators and robots is important. In this paper, two problems are addressed: (1) how a robot can change its behavior sequences in manipulation tasks with human intervention; (2) how a human operator can transfer information to a robot efficiently. We tackle the first problem by proposing a framework based on finite state machine to model the robot action sequences in manipulation tasks. The framework shows the way in which a robot slides its level of autonomy by considering the result of the transition action and the input of the human operator. The framework can be easily extended to include higher level of autonomy. To tackle the second problem, we proposed a method to encode human intentions into simple mouse gestures. With a discriminative classifier, the robot can recognize the mouse gesture drawn by the human operator and carry out the corresponding action. The classifier is based on PCA and has been tested on our data set collected from four volunteers with an average precision of 96.25%.

Original languageEnglish
Title of host publicationProceedings - 2016 9th International Conference on Human System Interactions, HSI 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages203-208
Number of pages6
ISBN (Electronic)9781509017294
DOIs
StatePublished - 2 Aug 2016
Event9th International Conference on Human System Interactions, HSI 2016 - Portsmouth, United Kingdom
Duration: 6 Jul 20168 Jul 2016

Publication series

NameProceedings - 2016 9th International Conference on Human System Interactions, HSI 2016

Conference

Conference9th International Conference on Human System Interactions, HSI 2016
Country/TerritoryUnited Kingdom
CityPortsmouth
Period6/07/168/07/16

Keywords

  • PCA-based Classifier
  • finite state machine
  • human robot interaction
  • mouse gestures

Fingerprint

Dive into the research topics of 'Interact with robot: An efficient approach based on finite state machine and mouse gesture recognition'. Together they form a unique fingerprint.

Cite this