Skip to main navigation Skip to search Skip to main content

Well Begun is Half Done: Training-Free and Model-Agnostic Semantically Guaranteed User Representation Initialization for Multimodal Recommendation

  • Jinfeng Xu
  • , Zheyu Chen
  • , Shuo Yang
  • , Jinze Li
  • , Hewei Wang
  • , Jianheng Tang
  • , Wei Wang
  • , Xiping Hu
  • , Edith C.H. Ngai*
  • *Corresponding author for this work
  • The University of Hong Kong
  • Beijing Institute of Technology
  • Carnegie Mellon University
  • Peking University
  • Macao Polytechnic University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Recent advancements in multimodal recommendations, which leverage diverse modality information to mitigate data sparsity and improve recommendation accuracy, have gained significant attention. However, existing multimodal recommendations overlook the critical role of user representation initialization. Unlike items, which are naturally associated with rich modality information, users lack such inherent information. Consequently, item representations initialized based on meaningful modality information and user representations initialized randomly exhibit a significant semantic gap. To this end, we propose a Semantically Guaranteed User Representation Initialization (SG-URInit). SG-URInit constructs the initial representation for each user by integrating both the modality features of the items they have interacted with and the global features of their corresponding clusters. SG-URInit enables the initialization of semantically enriched user representations that effectively capture both local (item-level) and global (cluster-level) semantics. Our SG-URInit is training-free and model-agnostic, meaning it can be seamlessly integrated into existing multimodal recommendation models without incurring any additional computational overhead during training. Extensive experiments on multiple real-world datasets demonstrate that incorporating SG-URInit into advanced multimodal recommendation models significantly enhances recommendation performance. Furthermore, the results show that SG-URInit can further alleviate the item cold-start problem and also accelerate model convergence, making it an efficient and practical solution for multimodal recommendations.

Original languageEnglish
Title of host publicationSIGIR 2026 - Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval
PublisherAssociation for Computing Machinery, Inc
Pages2096-2106
Number of pages11
ISBN (Electronic)9798400725999
DOIs
StatePublished - 19 Jul 2026
Externally publishedYes
Event49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026 - Melbourne, Australia
Duration: 20 Jul 202624 Jul 2026

Publication series

NameSIGIR 2026 - Proceedings of the 49th International ACM SIGIR Conference on Research and Development in Information Retrieval

Conference

Conference49th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2026
Country/TerritoryAustralia
CityMelbourne
Period20/07/2624/07/26

Keywords

  • initialization
  • multimodal
  • recommender system

Fingerprint

Dive into the research topics of 'Well Begun is Half Done: Training-Free and Model-Agnostic Semantically Guaranteed User Representation Initialization for Multimodal Recommendation'. Together they form a unique fingerprint.

Cite this