Skip to main navigation Skip to search Skip to main content

Few-shot relation extraction approach for threat intelligence based on multi-level attention mechanism and hybrid prototypical network

  • Yushun Xie
  • , Junchi Bao
  • , Rui Zong
  • , Zhaoquan Gu
  • , Haiyan Wang*
  • *Corresponding author for this work
  • University of Electronic Science and Technology of China
  • Ltd.
  • Pengcheng Laboratory
  • School of Computer Science and Technology, Harbin Institute of Technology

Research output: Contribution to journalArticlepeer-review

Abstract

With the increasing complexity of cyberattacks, the frequency and severity of cybersecurity incidents have escalated dramatically. Cyber Threat Intelligence (CTI) relation extraction plays a critical role in cybersecurity event analysis by identifying semantic relationships between security-related entities, thereby converting unstructured information into structured data formats. Nevertheless, within the domain of CTI, labeled datasets are limited, and the process of manual labeling incurs substantial costs, rendering it impractical on a large scale. To address these challenges, we propose a novel few-shot relation extraction method for small-scale threat intelligence data, termed RETI-MA-HP, which is based on a multi-level attention mechanism and a hybrid prototypical network. By integrating these advanced techniques, the RETI-MA-HP model is capable of learning from limited data and rapidly generalize to new relation classification tasks. To enhance the representational capacity of feature vectors, RETI-MA-HP incorporates a self-training module to refine the BERT-based encoder. Meanwhile, to mitigate misclassification arising from syntactically similar sentences, RETI-MA-HP employ contrastive learning to strengthen the hybrid prototypical network. Furthermore, we constructed a dedicated CTI dataset. Extensive experiments demonstrate that RETI-MA-HP achieves excellent performance across multiple tasks, attaining a maximum relation extraction accuracy of 75.44%, which constitutes a 15.5% improvement over compared models. These results prove that the effectiveness of RETI-MA-HP for relation extraction within the CTI domain.

Original languageEnglish
Article number100405
JournalArray
Volume26
DOIs
StatePublished - Jul 2025
Externally publishedYes

Keywords

  • Cyber Threat Intelligence
  • Few-shot learning
  • Hybrid prototypical network
  • Meta-learning
  • Multi-level attention mechanism
  • Relation extraction

Fingerprint

Dive into the research topics of 'Few-shot relation extraction approach for threat intelligence based on multi-level attention mechanism and hybrid prototypical network'. Together they form a unique fingerprint.

Cite this