Cloud Atlas: Efficient Fault Localization for Cloud Systems using Language Models and Causal Insight
This addresses the challenge of fault localization for cloud providers, enabling faster diagnosis and triage to improve reliability and availability, though it is incremental as it builds on existing causal reasoning methods.
The paper tackles the problem of automatically determining root causes of incidents in cloud systems by presenting Atlas, a novel approach that synthesizes causal graphs using large language models, system documentation, telemetry, and deployment feedback, achieving performance far surpassing data-driven algorithms and commensurate with ground-truth baselines.
Runtime failure and performance degradation is commonplace in modern cloud systems. For cloud providers, automatically determining the root cause of incidents is paramount to ensuring high reliability and availability as prompt fault localization can enable faster diagnosis and triage for timely resolution. A compelling solution explored in recent work is causal reasoning using causal graphs to capture relationships between varied cloud system performance metrics. To be effective, however, systems developers must correctly define the causal graph of their system, which is a time-consuming, brittle, and challenging task that increases in difficulty for large and dynamic systems and requires domain expertise. Alternatively, automated data-driven approaches have limited efficacy for cloud systems due to the inherent rarity of incidents. In this work, we present Atlas, a novel approach to automatically synthesizing causal graphs for cloud systems. Atlas leverages large language models (LLMs) to generate causal graphs using system documentation, telemetry, and deployment feedback. Atlas is complementary to data-driven causal discovery techniques, and we further enhance Atlas with a data-driven validation step. We evaluate Atlas across a range of fault localization scenarios and demonstrate that Atlas is capable of generating causal graphs in a scalable and generalizable manner, with performance that far surpasses that of data-driven algorithms and is commensurate to the ground-truth baseline.