Skip to main navigation Skip to search Skip to main content

DA-MLAD: Drift-Decomposed Meta-Learning for Continual Log Anomaly Detection in Supercomputing Systems

  • Harbin Institute of Technology
  • China Mobile Design Institute
  • Guangxi Institute of AI Security

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Large-scale supercomputing systems generate massive, continuously evolving log streams essential for fault diagnosis, but log pattern drift - caused by system upgrades, workload variations, and hardware aging - rapidly degrades detection models, missing emerging failures or flooding operators with false alarms. Existing online methods adapt blindly whenever distribution shifts occur, unable to distinguish genuine fault evolution from superficial format changes - leading to either over-adaptation that discards relevant knowledge, or under-adaptation that misses emerging failures. We present DA-MLAD, a drift-decomposed online meta-learning framework that first decomposes observed drift into its critical sources, then adapts accordingly. Our key insight is that fault concepts (memory errors, network timeouts, I/O stalls) provide a stable semantic view even as log syntax evolves. The core contribution is the Semantic Drift Ratio (SDR), which exploits the aggregation structure of concept mapping to decompose observed drift: by measuring shift at both template and concept levels, SDR disentangles surface-level format changes from semantic-level fault evolution, enabling principled adaptation that preserves knowledge when only formats change while learning aggressively when fault semantics genuinely evolve. Experiments on three production supercomputer logs (BGL, Thunderbird, Spirit) under closed-budget protocol (2.5% labeled templates, no extra supervision for meta-update) demonstrate 3.3-4.4 F1-point improvements over state-of-the-art methods under sustained drift, with 68% less forgetting.

Original languageEnglish
Title of host publicationICS 2026 - Proceedings of the 40th ACM International Conference on Supercomputing
PublisherAssociation for Computing Machinery
Pages675-686
Number of pages12
ISBN (Electronic)9798400725227
DOIs
StatePublished - 5 Jul 2026
Event40th ACM International Conference on Supercomputing, ICS 2026 - Belfast, United Kingdom
Duration: 6 Jul 20269 Jul 2026

Publication series

NameProceedings of the International Conference on Supercomputing
VolumePartF226351

Conference

Conference40th ACM International Conference on Supercomputing, ICS 2026
Country/TerritoryUnited Kingdom
CityBelfast
Period6/07/269/07/26

Keywords

  • Supercomputing reliability
  • concept drift
  • continual learning
  • log anomaly detection
  • online meta-learning

Fingerprint

Dive into the research topics of 'DA-MLAD: Drift-Decomposed Meta-Learning for Continual Log Anomaly Detection in Supercomputing Systems'. Together they form a unique fingerprint.

Cite this