Skip to main navigation Skip to search Skip to main content

Multimodal In-Vehicle Interaction Design to Support Situation Awareness and Reduce Motion Sickness in Autonomous Driving: A Systematic Review

  • Yifan Wu
  • , Qingchuan Li*
  • , Xin Chen
  • *Corresponding author for this work
  • Harbin Institute of Technology
  • Shenzhen University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Autonomous vehicles (AVs) are transforming transportation, shifting drivers into passive passengers. However, this shift raises challenges, including degraded situational awareness (SA) and increased motion sickness (MS). This review analyzes 50 relevant studies to explore existing strategies that utilize multimodal interactions to mitigate MS and enhance SA, while also examining the reciprocal relationship between MS and SA. The findings reveal that MS negatively impacts SA by increasing cognitive load and physiological discomfort, whereas strategies designed to enhance SA can indirectly alleviate MS by reducing sensory conflicts. Visual modalities and multimodal designs incorporating visual elements are the most widely adopted among these strategies. Integrating virtual reality (VR) in such designs also demonstrates a growing trend. Furthermore, the review evaluates the effectiveness of these strategies and identifies limitations, such as the lack of realism in experimental settings and insufficient attention to diverse user needs. This review integrates methods for mitigating MS and enhancing SA, providing a theoretical foundation and practical guidance for optimizing future human-vehicle interactions, and offering recommendations for designing safer and more comfortable autonomous driving experiences.

Original languageEnglish
Title of host publicationHuman Aspects of IT for the Aged Population - 11th International Conference, ITAP 2025, Held as Part of the 27th HCI International Conference, HCII 2025, Proceedings
EditorsQin Gao, Jia Zhou
PublisherSpringer Science and Business Media Deutschland GmbH
Pages120-138
Number of pages19
ISBN (Print)9783031927140
DOIs
StatePublished - 2025
Externally publishedYes
Event11th International Conference on Human Aspects of IT for the Aged Population, ITAP 2025, held as part of the 27th HCI International Conference on Human-Computer Interaction, HCII 2025 - Gothenburg, Sweden
Duration: 22 Jun 202527 Jun 2025

Publication series

NameLecture Notes in Computer Science
Volume15811 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference11th International Conference on Human Aspects of IT for the Aged Population, ITAP 2025, held as part of the 27th HCI International Conference on Human-Computer Interaction, HCII 2025
Country/TerritorySweden
CityGothenburg
Period22/06/2527/06/25

Keywords

  • Autonomous driving
  • Human-vehicle interaction
  • Motion Sickness (MS)
  • Multimodal interaction
  • Situational awareness (SA)
  • Systematic review

Fingerprint

Dive into the research topics of 'Multimodal In-Vehicle Interaction Design to Support Situation Awareness and Reduce Motion Sickness in Autonomous Driving: A Systematic Review'. Together they form a unique fingerprint.

Cite this