LGJul 7, 2023

CSCLog: A Component Subsequence Correlation-Aware Log Anomaly Detection Method

arXiv:2307.03359v11 citationsh-index: 33
Originality Incremental advance
AI Analysis

This addresses anomaly detection in system logs for intelligent operations, representing an incremental advance by modeling subsequence interactions.

The paper tackles log anomaly detection by proposing CSCLog, which captures sequential dependencies and implicit correlations of subsequences, achieving an average improvement of 7.41% in Macro F1-Measure over baselines on four datasets.

Anomaly detection based on system logs plays an important role in intelligent operations, which is a challenging task due to the extremely complex log patterns. Existing methods detect anomalies by capturing the sequential dependencies in log sequences, which ignore the interactions of subsequences. To this end, we propose CSCLog, a Component Subsequence Correlation-Aware Log anomaly detection method, which not only captures the sequential dependencies in subsequences, but also models the implicit correlations of subsequences. Specifically, subsequences are extracted from log sequences based on components and the sequential dependencies in subsequences are captured by Long Short-Term Memory Networks (LSTMs). An implicit correlation encoder is introduced to model the implicit correlations of subsequences adaptively. In addition, Graph Convolution Networks (GCNs) are employed to accomplish the information interactions of subsequences. Finally, attention mechanisms are exploited to fuse the embeddings of all subsequences. Extensive experiments on four publicly available log datasets demonstrate the effectiveness of CSCLog, outperforming the best baseline by an average of 7.41% in Macro F1-Measure.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes