Skip to main navigation Skip to search Skip to main content

T1D-MLLM: Multimodal Large Language Model and Cross-Scenario Dataset for Multi-Scenario Management of Type 1 Diabetes

  • Liangliang Liu
  • , Yi Guan
  • , Yanming Li
  • , Rujia Shen
  • , Guowei Zheng
  • , Chaoran Kong
  • , Jingchi Jiang*
  • , Yi Lin*
  • *Corresponding author for this work
  • Faculty of Computing, Harbin Institute of Technology
  • Harbin Medical University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The management of Type 1 Diabetes (T1D) involves comprehensive scenarios, including blood glucose prediction, risk assessment, and insulin dosing control. However, the heterogeneity of information requirements, task objectives, and behavioral logic poses challenges in constructing unified T1D management systems with conventional deep learning models, mainly attributed to insufficient capability of feature alignment and lack of high-quality multi-scenario T1D data. In this paper, we propose T1D-MLLM, the first multimodal large language model designed for unified multi-scenario T1D management, as well as construct LCT1D, a large-scale and cross-scenario T1D dataset. Specifically, T1D-MLLM integrates time-series physiological data with natural language descriptions to capture longterm dependencies across multiple management scenarios while also enhancing fine-grained perception of time-series. Meanwhile, to overcome data scarcity, we proposed a multimodal data generation paradigm based on expert strategies. By constructing task templates and applying a rule-driven alignment mechanism, we generated 150,000 high-quality expert samples with individualized physiological parameters, which provide rich and diverse training samples, significantly improving the T1D-MLLM's capabilities in heterogeneous feature alignment and cross-scenario inference. These experiments demonstrate the effectiveness of the T1D-MLLM in multi-scenarios of various tasks as a unified system, with an excellent performance that surpasses both opensource and proprietary models.

Original languageEnglish
Title of host publicationProceedings - 2025 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2025
EditorsJuan Liu, Jingshan Huang, Xiaowo Wang, Fa Zhang, Xiufen Zou, Tian Tian, Xiaohua Hu, Bin Hu, Yi Xiong
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1097-1103
Number of pages7
ISBN (Electronic)9798331515577
DOIs
StatePublished - 2025
Event2025 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2025 - Wuhan, China
Duration: 15 Dec 202518 Dec 2025

Publication series

NameProceedings - 2025 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2025

Conference

Conference2025 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2025
Country/TerritoryChina
CityWuhan
Period15/12/2518/12/25

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

  1. SDG 3 - Good Health and Well-being
    SDG 3 Good Health and Well-being

Keywords

  • Multimodal Data Generation
  • Multimodal Large Language Models
  • Multimodal Learning
  • T1D Health Management

Fingerprint

Dive into the research topics of 'T1D-MLLM: Multimodal Large Language Model and Cross-Scenario Dataset for Multi-Scenario Management of Type 1 Diabetes'. Together they form a unique fingerprint.

Cite this