Conflict-Aware Active Automata Learning (Extended Version)
This addresses a bottleneck in automata learning for scenarios with noise or system mutations, though it is incremental as it builds on recent work.
The paper tackles the problem of active automata learning algorithms being unable to handle conflicting observation data, which limits their use in noisy or mutating systems, by proposing the C3AL framework that enables conflict handling and minimizes tests, as shown in evaluation over 30 realistic targets and 18,000 scenarios.
Active automata learning algorithms cannot easily handle conflict in the observation data (different outputs observed for the same inputs). This inherent inability to recover after a conflict impairs their effective applicability in scenarios where noise is present or the system under learning is mutating. We propose the Conflict-Aware Active Automata Learning (C3AL) framework to enable handling conflicting information during the learning process. The core idea is to consider the so-called observation tree as a first-class citizen in the learning process. Though this idea is explored in recent work, we take it to its full effect by enabling its use with any existing learner and minimizing the number of tests performed on the system under learning, specially in the face of conflicts. We evaluate C3AL in a large set of benchmarks, covering over 30 different realistic targets, and over 18,000 different scenarios. The results of the evaluation show that C3AL is a suitable alternative framework for closed-box learning that can better handle noise and mutations.