Skip to main navigation Skip to search Skip to main content

Enhanced Gaze Following via Object Detection and Human Pose Estimation

  • College of Computer Science and Technology, Harbin Engineering University
  • Harbin Institute of Technology Shenzhen
  • Peng Cheng Laboratory

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The aim of gaze following is to estimate the gaze direction, which is useful for the understanding of human behaviour in various applications. However, it is still an open problem that has not been fully studied. In this paper, we present a novel framework for gaze following problem, where both the front/side face case and the back face case are taken into account. For the front/side face case, head pose estimation is applied to estimate the gaze, and then object detection is used to further refine the gaze direction by selecting the object that intersects with the gaze in a certain range. For the back face case, a deep neural network with the human pose information is proposed for gaze estimation. Experiments are carried out to demonstrate the superiority of the proposed method, as compared with the state-of-the-art method.

Original languageEnglish
Title of host publicationMultiMedia Modeling - 26th International Conference, MMM 2020, Proceedings
EditorsYong Man Ro, Junmo Kim, Jung-Woo Choi, Wen-Huang Cheng, Wei-Ta Chu, Peng Cui, Min-Chun Hu, Wesley De Neve
PublisherSpringer
Pages502-513
Number of pages12
ISBN (Print)9783030377335
DOIs
StatePublished - 2020
Externally publishedYes
Event26th International Conference on MultiMedia Modeling, MMM 2020 - Daejeon, Korea, Republic of
Duration: 5 Jan 20208 Jan 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11962 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference26th International Conference on MultiMedia Modeling, MMM 2020
Country/TerritoryKorea, Republic of
CityDaejeon
Period5/01/208/01/20

Keywords

  • Deep neural network
  • Gaze following
  • Human pose estimation
  • Objection detection

Fingerprint

Dive into the research topics of 'Enhanced Gaze Following via Object Detection and Human Pose Estimation'. Together they form a unique fingerprint.

Cite this