Skip to main navigation Skip to search Skip to main content

The Current Challenges of Software Engineering in the Era of Large Language Models

  • Cuiyun Gao
  • , Xing Hu
  • , Shan Gao
  • , Xin Xia
  • , Zhi Jin*
  • *Corresponding author for this work
  • Harbin Institute of Technology Shenzhen
  • Zhejiang University
  • Huawei Technologies Co Ltd China
  • Huawei Technologies Co., Ltd.
  • Peking University

Research output: Contribution to journalArticlepeer-review

Abstract

With the advent of large language models (LLMs) in the AI area, the field of software engineering (SE) has also witnessed a paradigm shift. These models, by leveraging the power of deep learning and massive amounts of data, have demonstrated an unprecedented capacity to understand, generate, and operate programming languages. They can assist developers in completing a broad spectrum of software development activities, encompassing software design, automated programming, and maintenance, which potentially reduces huge human efforts. Integrating LLMs within the SE landscape (LLM4SE) has become a burgeoning trend, necessitating exploring this emergent landscape's challenges and opportunities.The article aims at revisiting the software development lifecycle (SDLC) under LLMs, and highlighting challenges and opportunities of the new paradigm. The article first summarizes the overall process of LLM4SE, and then elaborates on the current challenges based on a through discussion. The discussion was held among more than 20 participants from academia and industry, specializing in fields such as SE and artificial intelligence. Specifically, we achieve 26 key challenges from seven aspects, including software requirement and design, coding assistance, testing code generation, code review, code maintenance, software vulnerability management, and data, training, and evaluation. We hope the achieved challenges would benefit future research in the LLM4SE field.

Original languageEnglish
Article number127
JournalACM Transactions on Software Engineering and Methodology
Volume34
Issue number5
DOIs
StatePublished - 27 May 2025
Externally publishedYes

Keywords

  • Challenges
  • LLM4SE
  • Large Language Models

Fingerprint

Dive into the research topics of 'The Current Challenges of Software Engineering in the Era of Large Language Models'. Together they form a unique fingerprint.

Cite this