Skip to main navigation Skip to search Skip to main content

Continual Conceptual Entity Learning for Text-to-Image Generative Models

  • Yabin Wang
  • , Xiaopeng Hong*
  • , Zhiheng Ma
  • , Zhou Su
  • , Jinpeng Zhang
  • , Zhiwu Huang
  • *Corresponding author for this work
  • Harbin Institute of Technology
  • Shenzhen Institute of Advanced Technology
  • Xi'an Jiaotong University
  • Intelligent Science Technology Academy of Casic

Research output: Contribution to journalArticlepeer-review

Abstract

Current Text-to-Image generative models struggle to continuously learn multiple distinct entities or concepts, limiting their scalability and hindering practical deployment in dynamic environments. We formulate this task as Continual Conceptual Entity Learning (CEL) and propose a novel framework called Continual Entity Adapter Learning (CEAL). CEAL leverages a compact set of tunable parameters, termed SuperLoRA, to efficient and scalable learning of new entities. We propose a dynamic rank-increasing strategy to train the SuperLoRA, balancing computational efficiency with performance. To evaluate our method, we create three benchmarks encompassing generic objects, human faces, and artistic styles. Experimental results demonstrate that CEAL effectively learns new entities while preserving prior knowledge, outperforming existing methods in both entity fidelity and parameter efficiency.

Original languageEnglish
JournalIEEE Transactions on Multimedia
DOIs
StateAccepted/In press - 2026

Keywords

  • Continual learning
  • diffusion models
  • text-to-image synthesis

Fingerprint

Dive into the research topics of 'Continual Conceptual Entity Learning for Text-to-Image Generative Models'. Together they form a unique fingerprint.

Cite this