Skip to main navigation Skip to search Skip to main content

ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Development

  • Zhenran Xu
  • , Xue Yang*
  • , Yiyu Wang
  • , Qingli Hu
  • , Zijiao Wu
  • , Longyue Wang
  • , Weihua Luo
  • , Kaifu Zhang
  • , Baotian Hu*
  • , Min Zhang
  • *Corresponding author for this work
  • Alibaba Group Holding Ltd.
  • Harbin Institute of Technology Shenzhen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We introduce ComfyUI-Copilot, a large language model-powered plugin designed to enhance the usability and efficiency of ComfyUI, an open-source platform for AI-driven art creation. Despite its flexibility and user-friendly interface, ComfyUI can present challenges to newcomers, including limited documentation, model misconfigurations, and the complexity of workflow design. ComfyUI-Copilot addresses these challenges by offering intelligent node and model recommendations, along with automated one-click workflow construction. At its core, the system employs a hierarchical multi-agent framework comprising a central assistant agent for task delegation and specialized worker agents for different usages, supported by our curated ComfyUI knowledge bases to streamline debugging and deployment. We validate the effectiveness of ComfyUI-Copilot through both offline quantitative evaluations and online user feedback, showing that it accurately recommends nodes and accelerates workflow development. Additionally, use cases illustrate that ComfyUI-Copilot lowers entry barriers for beginners and enhances workflow efficiency for experienced users. The ComfyUI-Copilot installation package and a demo video are available at https://github.com/AIDC-AI/ComfyUI-Copilot.

Original languageEnglish
Title of host publicationSystem Demonstrations
EditorsPushkar Mishra, Smaranda Muresan, Tao Yu
PublisherAssociation for Computational Linguistics (ACL)
Pages632-643
Number of pages12
ISBN (Electronic)9798891762534
DOIs
StatePublished - 2025
Externally publishedYes
Event63rd Annual Meeting of the Association for Computational Linguistics, ACL 2025 - Vienna, Austria
Duration: 27 Jul 20251 Aug 2025

Publication series

NameProceedings of the Annual Meeting of the Association for Computational Linguistics
Volume3
ISSN (Print)0736-587X

Conference

Conference63rd Annual Meeting of the Association for Computational Linguistics, ACL 2025
Country/TerritoryAustria
CityVienna
Period27/07/251/08/25

Fingerprint

Dive into the research topics of 'ComfyUI-Copilot: An Intelligent Assistant for Automated Workflow Development'. Together they form a unique fingerprint.

Cite this