A Category-Driven Contrastive Recovery Network for Double Incomplete Multi-View Multi-Label Classification

  • Yiming Wang
  • , Qun Li
  • , Dongxia Chang
  • , Jie Wen
  • , Fu Xiao*
  • , Yao Zhao
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

In the field of multi-view multi-label learning, the challenges of incomplete views and missing labels are prevalent due to the complexity of manual labeling and data acquisition errors. These challenges significantly reduce the quality of latent representations and hinder prediction by multi-label classification. To address this issue, we propose a novel Category-driven Semi-supervised Contrastive Recovery (CSCR) framework in this study. Our framework aims to fully integrate existing label information into incomplete representation learning and classification. Specifically, to address the limitations posed by incomplete views and labels, we construct a label coincidence matrix based on existing labels, which serves as a similarity matrix in subsequent semi-supervised contrastive learning and multi-view classification. By leveraging this matrix, we design a semi-supervised multi-view contrastive learning module, which constructs sample pairs on the basis of inter-view correspondences and label similarity. It learns discriminative latent representations without the need for data augmentation. A weighted multi-label classification module is subsequently employed to integrate the predictions from each view to obtain the final classification result. Experimental evaluations on five challenging datasets demonstrate the superiority of our model over existing state-of-the-art methods.

Original languageEnglish
Pages (from-to)4008-4017
Number of pages10
JournalIEEE Transactions on Multimedia
Volume27
DOIs
StatePublished - 2025
Externally publishedYes

Keywords

  • Incomplete multi-view learning
  • multi-label classification
  • semi-supervised contrastive learning

Fingerprint

Dive into the research topics of 'A Category-Driven Contrastive Recovery Network for Double Incomplete Multi-View Multi-Label Classification'. Together they form a unique fingerprint.

Cite this