Skip to main navigation Skip to search Skip to main content

System Report for CCL24-Eval Task 1: Leveraging LLMs for Chinese Frame Semantic Parsing

  • Soochow University

Research output: Contribution to conferencePaperpeer-review

Abstract

We participate in the open track of the Chinese frame semantic parsing (CFSP) task, i.e., CCL24-Eval Task 1, and our submission ranks first. FSP is an important task in Natural Language Processing, aiming to extract the frame semantic structures from sentences, which can be divided into three subtasks, e.g., Frame Identification (FI), Argument Identification (AI), and Role Identification (RI). In this paper, we use the LLM Gemini 1.0 to evaluate the three subtasks of CFSP, and present the techniques and strategies we employed to enhance subtasks performance. For FI, we leverage mapping and similarity strategies to minimize the candidate frames for each target word, which can reduce the complexity of the LLM in identifying the appropriate frame. For AI and RI subtasks, we utilize the results from small models as auxiliary information and apply data augmentation, self-training, and model ensemble techniques on these small models to further enhance the performance of subtasks.

Original languageEnglish
Pages21-31
Number of pages11
StatePublished - 2024
Externally publishedYes
Event23rd Chinese National Conference on Computational Linguistics, CCL 2024 - Taiyuan, China
Duration: 24 Jul 202428 Jul 2024

Conference

Conference23rd Chinese National Conference on Computational Linguistics, CCL 2024
Country/TerritoryChina
CityTaiyuan
Period24/07/2428/07/24

Fingerprint

Dive into the research topics of 'System Report for CCL24-Eval Task 1: Leveraging LLMs for Chinese Frame Semantic Parsing'. Together they form a unique fingerprint.

Cite this