Skip to main navigation Skip to search Skip to main content

An Anomaly Detection Framework for System Logs Based on Ensemble Learning

  • Wenjing Xiong
  • , Wu Chen*
  • , Jiamou Liu
  • , Kaiqi Zhao
  • *Corresponding author for this work
  • Southwest University
  • The University of Auckland

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Logs offer vital insights into system states and contextual details, crucial for identifying anomalies. Numerous machine learning and deep learning approaches have been proposed for log anomaly detection. Recent studies reveal that distinct software systems tend to generate a substantial volume of complexity and diversity of logs that exhibit considerable discrepancies in class distribution. In this paper, we introduce IELog, a framework for anomaly detection. IELog employs DSS (Denoise Selection Sampling) to oversample the minority class, mitigating imbalanced data impact. Subsequently, IELog proposes the AW (Anomaly Weighting) ensemble rule to effectively combine the prediction outcomes of individual base models, leveraging their distinct strengths. Extensive experiments have been performed on four different public log datasets, which demonstrate the validity of the proposed framework IELog.

Original languageEnglish
Title of host publicationPRICAI 2023
Subtitle of host publicationTrends in Artificial Intelligence - 20th Pacific Rim International Conference on Artificial Intelligence, PRICAI 2023, Proceedings
EditorsFenrong Liu, Arun Anand Sadanandan, Duc Nghia Pham, Petrus Mursanto, Dickson Lukose
PublisherSpringer Science and Business Media Deutschland GmbH
Pages52-65
Number of pages14
ISBN (Print)9789819970186
DOIs
StatePublished - 2024
Externally publishedYes
Event20th Pacific Rim International Conference on Artificial Intelligence, PRICAI 2023 - Jakarta, Indonesia
Duration: 15 Nov 202319 Nov 2023

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14325 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference20th Pacific Rim International Conference on Artificial Intelligence, PRICAI 2023
Country/TerritoryIndonesia
CityJakarta
Period15/11/2319/11/23

Keywords

  • Ensemble learning
  • Imbalanced data
  • Log anomaly detection

Fingerprint

Dive into the research topics of 'An Anomaly Detection Framework for System Logs Based on Ensemble Learning'. Together they form a unique fingerprint.

Cite this