CCL23-Eval 任务 6 总结报告:电信网络诈骗案件分类

Chengjie Sun; Jie Ji; Boyue Shang; Bingquan Liu

CCL23-Eval 任务 6 总结报告:电信网络诈骗案件分类

Translated title of the contribution: Overview of CCL23-Eval Task 6: Telecom Network Fraud Case Classification

Chengjie Sun
, Jie Ji
, Boyue Shang
, Bingquan Liu

Faculty of Computing

Harbin Institute of Technology
Harbin Public Security Bureau

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

3 Scopus citations

Abstract

In recent years, the situation of telecom network fraud has been severe, and automated case classification can help fight crime. This article introduces the task-related classification system, and then introduces and displays the relevant information of this evaluation task from the aspects of data sets, task introduction, and competition results. A total of 60 participating teams signed up for this task, and finally 34 teams submitted results, of which 15 teams scored more than baseline, the highest score was 0.8660, which was 1.6% higher than baseline. According to the analysis of the results, most of the teams have adopted the BERT-like model.

Translated title of the contribution	Overview of CCL23-Eval Task 6: Telecom Network Fraud Case Classification
Original language	Chinese (Traditional)
Title of host publication	Evaluations
Editors	Maosong Sun, Bing Qin, Xipeng Qiu, Jing Jiang, Xianpei Han
Publisher	Association for Computational Linguistics (ACL)
Pages	193-200
Number of pages	8
ISBN (Electronic)	9781713889908
State	Published - 2023
Event	22nd Chinese National Conference on Computational Linguistics, CCL 2023 - Harbin, China Duration: 3 Aug 2023 → 5 Aug 2023

Publication series

Name	Proceedings of the 22nd Chinese National Conference on Computational Linguistics, CCL 2023
Volume	3

Conference

Conference	22nd Chinese National Conference on Computational Linguistics, CCL 2023
Country/Territory	China
City	Harbin
Period	3/08/23 → 5/08/23

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 16 Peace, Justice and Strong Institutions

Cite this

@inproceedings{db2aeb5518e745919bf07a5bef9382da,

title = "CCL23-Eval 任务 6 总结报告:电信网络诈骗案件分类",

abstract = "In recent years, the situation of telecom network fraud has been severe, and automated case classification can help fight crime. This article introduces the task-related classification system, and then introduces and displays the relevant information of this evaluation task from the aspects of data sets, task introduction, and competition results. A total of 60 participating teams signed up for this task, and finally 34 teams submitted results, of which 15 teams scored more than baseline, the highest score was 0.8660, which was 1.6\% higher than baseline. According to the analysis of the results, most of the teams have adopted the BERT-like model.",

keywords = "BERT, Telecom Network Fraud, Text Classification",

author = "Chengjie Sun and Jie Ji and Boyue Shang and Bingquan Liu",

note = "Publisher Copyright: {\textcopyright} 2023 China National Conference on Computational Linguistics.; 22nd Chinese National Conference on Computational Linguistics, CCL 2023 ; Conference date: 03-08-2023 Through 05-08-2023",

year = "2023",

language = "繁体中文",

series = "Proceedings of the 22nd Chinese National Conference on Computational Linguistics, CCL 2023",

publisher = "Association for Computational Linguistics (ACL)",

pages = "193--200",

editor = "Maosong Sun and Bing Qin and Xipeng Qiu and Jing Jiang and Xianpei Han",

booktitle = "Evaluations",

address = "澳大利亚",

}

Sun, C, Ji, J, Shang, B & Liu, B 2023, CCL23-Eval 任务 6 总结报告:电信网络诈骗案件分类. in M Sun, B Qin, X Qiu, J Jiang & X Han (eds), Evaluations. Proceedings of the 22nd Chinese National Conference on Computational Linguistics, CCL 2023, vol. 3, Association for Computational Linguistics (ACL), pp. 193-200, 22nd Chinese National Conference on Computational Linguistics, CCL 2023, Harbin, China, 3/08/23.

CCL23-Eval 任务 6 总结报告:电信网络诈骗案件分类. / Sun, Chengjie; Ji, Jie; Shang, Boyue et al.
Evaluations. ed. / Maosong Sun; Bing Qin; Xipeng Qiu; Jing Jiang; Xianpei Han. Association for Computational Linguistics (ACL), 2023. p. 193-200 (Proceedings of the 22nd Chinese National Conference on Computational Linguistics, CCL 2023; Vol. 3).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - CCL23-Eval 任务 6 总结报告:电信网络诈骗案件分类

AU - Sun, Chengjie

AU - Ji, Jie

AU - Shang, Boyue

AU - Liu, Bingquan

PY - 2023

Y1 - 2023

N2 - In recent years, the situation of telecom network fraud has been severe, and automated case classification can help fight crime. This article introduces the task-related classification system, and then introduces and displays the relevant information of this evaluation task from the aspects of data sets, task introduction, and competition results. A total of 60 participating teams signed up for this task, and finally 34 teams submitted results, of which 15 teams scored more than baseline, the highest score was 0.8660, which was 1.6% higher than baseline. According to the analysis of the results, most of the teams have adopted the BERT-like model.

AB - In recent years, the situation of telecom network fraud has been severe, and automated case classification can help fight crime. This article introduces the task-related classification system, and then introduces and displays the relevant information of this evaluation task from the aspects of data sets, task introduction, and competition results. A total of 60 participating teams signed up for this task, and finally 34 teams submitted results, of which 15 teams scored more than baseline, the highest score was 0.8660, which was 1.6% higher than baseline. According to the analysis of the results, most of the teams have adopted the BERT-like model.

KW - BERT

KW - Telecom Network Fraud

KW - Text Classification

UR - https://www.scopus.com/pages/publications/85213226765

M3 - 会议稿件

AN - SCOPUS:85213226765

T3 - Proceedings of the 22nd Chinese National Conference on Computational Linguistics, CCL 2023

SP - 193

EP - 200

BT - Evaluations

A2 - Sun, Maosong

A2 - Qin, Bing

A2 - Qiu, Xipeng

A2 - Jiang, Jing

A2 - Han, Xianpei

PB - Association for Computational Linguistics (ACL)

T2 - 22nd Chinese National Conference on Computational Linguistics, CCL 2023

Y2 - 3 August 2023 through 5 August 2023

ER -

CCL23-Eval 任务 6 总结报告:电信网络诈骗案件分类

Abstract

Publication series

Conference

UN SDGs

Other files and links

Fingerprint

Cite this