Skip to main navigation Skip to search Skip to main content

NeuroAlign: Hierarchical multimodal fusion of dynamic and structural neuroimaging for MCI analysis

  • Xiongri Shen
  • , Zhenxi Song
  • , Jiaqi Wang
  • , Yi Zhong
  • , Leilei Zhao
  • , Chenqi Xu
  • , Linling Li
  • , Yichen Wei
  • , Lingyan Liang
  • , Demao Deng
  • , Luping Song
  • , Ping Luan
  • , Ahmed M. Anter
  • , Shuqiang Wang
  • , Baiying Lei
  • , Zhiguo Zhang*
  • *Corresponding author for this work
  • Harbin Institute of Technology
  • Harbin Institute of Technology
  • Beijing University of Posts and Telecommunications
  • Shenzhen University
  • People's Hospital of Guangxi Zhuang Autonomous Region
  • Huazhong University of Science and Technology
  • Egypt-Japan University of Science and Technology
  • Shenzhen Institute of Advanced Technology
  • Intelligence and Machines

Research output: Contribution to journalArticlepeer-review

Abstract

Multimodal neuroimaging fusion of functional MRI (fMRI) and diffusion tensor imaging (DTI) provides complementary information for cognitive impairment analysis, but remains challenged by heterogeneous feature spaces and misaligned representations. We propose NeuroAlign , a hierarchical framework for structured multimodal fusion. It introduces (1) Dual-Modal Hierarchical Alignment (DMHA), which models multi-scale dynamic connectivity and aligns dynamic–static and functional–structural embeddings; and (2) Dual-Domain Hierarchical Interaction (DDHI), which enables fine-grained modulation and global interaction between connectivity- and region-level features. To support feature-level inspection, we design Synergistic Activation Mapping (SAM), a gradient-free, marker-oriented attribution method for DFC, SFC, ALFF, and FA. Evaluated on GUTCM, ADNI, and OASIS under five-fold validation, NeuroAlign achieves competitive MCI/SCD detection and preliminary cross-dataset transferability. Attribution analyses reveal modality-specific and partially consistent brain patterns, providing model-derived evidence for multimodal representation analysis.

Original languageEnglish
Article number104705
JournalInformation Fusion
Volume138
DOIs
StatePublished - Feb 2027
Externally publishedYes

Keywords

  • Cognitive impairment
  • Functional-structural connectivity
  • Functional-structural fusion
  • fMRI-DTI

Fingerprint

Dive into the research topics of 'NeuroAlign: Hierarchical multimodal fusion of dynamic and structural neuroimaging for MCI analysis'. Together they form a unique fingerprint.

Cite this