Skip to main navigation Skip to search Skip to main content

Dual Regression-Enhanced Gaze Target Detection in the Wild

  • Xinming Wang
  • , Hanlin Zhang
  • , Zhiyong Wang
  • , Wei Nie
  • , Zhihao Yang
  • , Weihong Ren
  • , Qiong Xu
  • , Xiu Xu*
  • , Honghai Liu*
  • *Corresponding author for this work
  • Harbin Institute of Technology Shenzhen
  • Children's Hospital of Fudan University
  • University of Portsmouth

Research output: Contribution to journalArticlepeer-review

Abstract

Gaze is a vital feature in analyzing natural human behavior and social interaction. Existing gaze target detection studies learn gaze from gaze orientations and scene cues via a neural network to model gaze in unconstrained scenes. Though achieve decent accuracy, these studies either employ complex model architectures or leverage additional depth information, which limits the model application. This article proposes a simple and effective gaze target detection model that employs dual regression to improve detection accuracy while maintaining low model complexity. Specifically, in the training phase, the model parameters are optimized under the supervision of coordinate labels and corresponding Gaussian-smoothed heatmap labels. In the inference phase, the model outputs the gaze target in the form of coordinates as prediction rather than heatmaps. Extensive experimental results on within-dataset and cross-dataset evaluations on public datasets and clinical data of autism screening demonstrate that our model has high accuracy and inference speed with solid generalization capabilities.

Original languageEnglish
Pages (from-to)219-229
Number of pages11
JournalIEEE Transactions on Cybernetics
Volume54
Issue number1
DOIs
StatePublished - 1 Jan 2024
Externally publishedYes

Keywords

  • Autism spectrum disorder (ASD)
  • dual regression
  • gaze target detection

Fingerprint

Dive into the research topics of 'Dual Regression-Enhanced Gaze Target Detection in the Wild'. Together they form a unique fingerprint.

Cite this