TY - GEN
T1 - Designing Human-machine Collaboration Interface Through Multimodal Combination Optimization to Improve Takeover Performance in Highly Automated Driving
AU - Zhu, Jieyu
AU - Zhang, Yiran
AU - Ma, Yanli
AU - Lv, Chen
AU - Zhang, Yaping
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Drivers in highly automated vehicles (AVs) are not required to continuously monitor the AV system. However, they must be prepared to take over vehicles when requested. Therefore, it is necessary to design an in-cabin interface that allows drivers to adapt their levels of preparedness to the likelihood of control transition. This study examined the interaction effects of (1) takeover request modality (TORM), (2) non-driving related tasks (NDRT), (3) takeover lead time (TOLT) on takeover performance. We conducted a driver-in-the-loop experiment involving 32 participants based on 15 takeover requests (TORs) for each NDRT. The Particle swarm optimization algorithm combined with multilayer perceptron learning was used for multi-objective balance optimization of five performance indicators. Results showed that the utilization of tactile-auditory prompts with 5 s and 9 s TOLTs exhibited positive performance in music listening and no task situations. The integration of tactile-auditory or tactile-visual cues with 7 s and 9 s TOLTs yielded favorable results in reading scenarios, whereas the tactile cues demonstrated efficacy in video watching scenarios. The situation of visual with 5 s TOLT reached the optimal balance of the five optimization objectives when the driver performed no task. This finding can offer valuable guidance to design interfaces in highly automated vehicles.
AB - Drivers in highly automated vehicles (AVs) are not required to continuously monitor the AV system. However, they must be prepared to take over vehicles when requested. Therefore, it is necessary to design an in-cabin interface that allows drivers to adapt their levels of preparedness to the likelihood of control transition. This study examined the interaction effects of (1) takeover request modality (TORM), (2) non-driving related tasks (NDRT), (3) takeover lead time (TOLT) on takeover performance. We conducted a driver-in-the-loop experiment involving 32 participants based on 15 takeover requests (TORs) for each NDRT. The Particle swarm optimization algorithm combined with multilayer perceptron learning was used for multi-objective balance optimization of five performance indicators. Results showed that the utilization of tactile-auditory prompts with 5 s and 9 s TOLTs exhibited positive performance in music listening and no task situations. The integration of tactile-auditory or tactile-visual cues with 7 s and 9 s TOLTs yielded favorable results in reading scenarios, whereas the tactile cues demonstrated efficacy in video watching scenarios. The situation of visual with 5 s TOLT reached the optimal balance of the five optimization objectives when the driver performed no task. This finding can offer valuable guidance to design interfaces in highly automated vehicles.
KW - Highly automated driving
KW - Human-machine Interface
KW - Non-driving related tasks
KW - Takeover lead time
KW - Takeover request modality
UR - https://www.scopus.com/pages/publications/85186489478
U2 - 10.1109/ITSC57777.2023.10422343
DO - 10.1109/ITSC57777.2023.10422343
M3 - 会议稿件
AN - SCOPUS:85186489478
T3 - IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC
SP - 4895
EP - 4900
BT - 2023 IEEE 26th International Conference on Intelligent Transportation Systems, ITSC 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 26th IEEE International Conference on Intelligent Transportation Systems, ITSC 2023
Y2 - 24 September 2023 through 28 September 2023
ER -