Skip to main navigation Skip to search Skip to main content

CLGraph: A Contrastive Learning-Based Multimodal Fusion Approach for Spatial Domain Identification

  • Sijing Du
  • , Yangen Zhan
  • , Yongbing Zhang*
  • *Corresponding author for this work
  • Harbin Institute of Technology
  • Tsinghua University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Spatial transcriptomics technologies provide multi-modal data for exploring tissue architecture domains, cell types, intercellular communication, and their biological consequences, including high-throughput gene expression, spatial coordinates, and histological background. In spatial domain identification, spatial transcriptomics data reveal the positions and functions of cells within tissue structures. Existing spatial domain detection methods do not fully leverage the unique spatial properties of spatial transcriptomics data and the morphological features in corresponding tissue images. To integrate the complex relationships among multimodal data, this paper proposes an optimized representation model based on graph contrastive learning. It utilizes complementary information among different modalities to jointly optimize low-dimensional embeddings of gene expression profiles. The paper validates the performance of the proposed model in spatial domain identification across multiple datasets, demonstrating consistency with biological annotations. Additionally, spatially variable genes identified based on clustering results align with certain marker genes.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE International Conference on Medical Artificial Intelligence, MedAI 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages201-211
Number of pages11
ISBN (Electronic)9798350377613
DOIs
StatePublished - 2024
Externally publishedYes
Event2nd IEEE International Conference on Medical Artificial Intelligence, MedAI 2024 - Chongqing, China
Duration: 15 Nov 202417 Nov 2024

Publication series

NameProceedings - 2024 IEEE International Conference on Medical Artificial Intelligence, MedAI 2024

Conference

Conference2nd IEEE International Conference on Medical Artificial Intelligence, MedAI 2024
Country/TerritoryChina
CityChongqing
Period15/11/2417/11/24

Keywords

  • graph contrastive learning
  • multimodal information fusion
  • spatial domain identification
  • spatial transcriptomics
  • spatially variable gene detection

Fingerprint

Dive into the research topics of 'CLGraph: A Contrastive Learning-Based Multimodal Fusion Approach for Spatial Domain Identification'. Together they form a unique fingerprint.

Cite this