Skip to main navigation Skip to search Skip to main content

Multi-View Contrastive Parsing Network for Emotion Recognition in Multi-Party Conversations

  • Faculty of Computing, Harbin Institute of Technology

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Recent Emotion Recognition in Conversation (ERC) works significantly outperform large language models, represented by ChatGPT, in the dyadic conversation environment by introducing knowledge and adjusting training strategies. However, Multi-Party Conversations (MPCs) are more complex due to their multi-thread nature, low information density, and general long-range dependencies. In addition, previous studies have overlooked the phenomenon of utterance polysemy. To address these challenges, this paper proposes a Multi-View Contrastive Parsing Network (MuVCPN). Specifically, we first parse the entire conversation and extract emotion-related cues from independent sub-conversation views. Then, we update the utterance distance based on the parsing results and use a discourse structure-aware self-attention mechanism to capture the conversational information flow from the global view. At the same time, we adopt supervised contrastive learning to group utterances from the same sub-conversation together. Extensive experiments on four benchmarks show that the proposed MuVCPN model outperforms baseline models on the ERC task. Additionally, experimental results indicate that utilizing different views and sub-conversation level contrastive learning can improve performance in the MPCs environment.

Original languageEnglish
Title of host publication2024 International Joint Conference on Neural Networks, IJCNN 2024 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350359312
DOIs
StatePublished - 2024
Externally publishedYes
Event2024 International Joint Conference on Neural Networks, IJCNN 2024 - Yokohama, Japan
Duration: 30 Jun 20245 Jul 2024

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Conference

Conference2024 International Joint Conference on Neural Networks, IJCNN 2024
Country/TerritoryJapan
CityYokohama
Period30/06/245/07/24

Keywords

  • contrastive learning
  • emotion recognition in conversation
  • multi-party conversation
  • multi-view

Fingerprint

Dive into the research topics of 'Multi-View Contrastive Parsing Network for Emotion Recognition in Multi-Party Conversations'. Together they form a unique fingerprint.

Cite this