Skip to main navigation Skip to search Skip to main content

Dynamic-Attention-Based EEG State Transition Modeling for Emotion Recognition

  • Xinke Shen
  • , Runmin Gan
  • , Kaixuan Wang
  • , Shuyi Yang
  • , Qingzhu Zhang
  • , Quanying Liu
  • , Dan Zhang*
  • , Sen Song*
  • *Corresponding author for this work
  • Southern University of Science and Technology
  • Tsinghua University
  • Beijing Normal University

Research output: Contribution to journalArticlepeer-review

Abstract

Electroencephalogram (EEG)-based emotion decoding can objectively quantify people’s emotional state and has broad application prospects in human-computer interaction and early detection of emotional disorders. Recently emerging deep learning architectures have significantly improved the performance of EEG emotion decoding. However, existing methods still fall short of fully capturing the complex spatiotemporal dynamics of neuralsignals, which are crucial for representing emotion processing. This study proposes a Dynamic-Attention-based EEG State Transition (DAEST) modeling method to characterize EEG spatiotemporal dynamics. The model extracts spatiotemporal components of EEG that represent multiple parallel neural processes and estimates dynamic attention weights on these components to capture transitions in brain states. The model is optimized within a contrastive learning framework for cross-subject emotion recognition. The proposed method achieved state-of-the-art performance onthree publicly available datasets: FACED, SEED, and SEED-V. It achieved 81.7 ± 4.3% accuracy in the binary classification of positive and negative emotions and 67.9 ± 7.3% in nine-class dis-crete emotion classification on the FACED dataset, 88.1 ± 3.6% in the three-class classification of positive, negative, and neutral emotions on the SEED dataset, and 73.6 ± 12.7% in five-classdiscrete emotion classification on the SEED-V dataset. The learned EEG spatiotemporal patterns and dynamic transition propertiesoffer valuable insights into neural dynamics underlying emotion processing.

Original languageEnglish
Pages (from-to)3552-3568
Number of pages17
JournalIEEE Transactions on Affective Computing
Volume16
Issue number4
DOIs
StatePublished - 2025
Externally publishedYes

Keywords

  • Dynamic attention
  • EEG
  • emotion recognition
  • state transition

Fingerprint

Dive into the research topics of 'Dynamic-Attention-Based EEG State Transition Modeling for Emotion Recognition'. Together they form a unique fingerprint.

Cite this