LogTinyLLM: Tiny Large Language Models Based Contextual Log Anomaly Detection
This work addresses log anomaly detection for system maintenance, but it is incremental as it applies existing fine-tuning techniques to a specific domain.
The paper tackled log anomaly detection by applying parameter-efficient fine-tuning methods like LoRA to tiny large language models on the Thunderbird dataset, achieving accuracy improvements of 18 to 19 percentage points over LogBert, with scores up to 98.83% compared to 79.37%.
Log anomaly detection using traditional rule based or deep learning based methods is often challenging due to the large volume and highly complex nature of log sequence. So effective way of detection of anomalous sequence of logs is crucial for system maintenance and development. This paper proposes parameter efficient finetuning specifically low rank adaptation (LoRA) and adapter based approaches for finding contextual anomalies in sequence of logs in large log data set. It compares different tiny large language models (LLMs) on the Thunderbird dataset. The results show that LoRA based finetuning provides substantial performance improvements of 18 to 19 percentage over LogBert based full finetuning approach, achieving accuracy scores between 97.76% and 98.83% compared to 79.37%.