The Rise of Agentic Testing: Multi-Agent Systems for Robust Software Quality Assurance
This addresses the need for more robust and autonomous software quality assurance, particularly for microservice-based applications, though it appears incremental as it builds on existing multi-agent and feedback-driven concepts.
The paper tackled the problem of AI-based test generators producing invalid or redundant tests by introducing a multi-agent, closed-loop framework that autonomously generates, executes, and refines tests, resulting in up to a 60% reduction in invalid tests and 30% coverage improvement.
Software testing has progressed toward intelligent automation, yet current AI-based test generators still suffer from static, single-shot outputs that frequently produce invalid, redundant, or non-executable tests due to the lack of execution aware feedback. This paper introduces an agentic multi-model testing framework a closed-loop, self-correcting system in which a Test Generation Agent, an Execution and Analysis Agent, and a Review and Optimization Agent collaboratively generate, execute, analyze, and refine tests until convergence. By using sandboxed execution, detailed failure reporting, and iterative regeneration or patching of failing tests, the framework autonomously improves test quality and expands coverage. Integrated into a CI/CD-compatible pipeline, it leverages reinforcement signals from coverage metrics and execution outcomes to guide refinement. Empirical evaluations on microservice based applications show up to a 60% reduction in invalid tests, 30% coverage improvement, and significantly reduced human effort compared to single-model baselines demonstrating that multi-agent, feedback-driven loops can evolve software testing into an autonomous, continuously learning quality assurance ecosystem for self-healing, high-reliability codebases.