ViSTA: a Framework for Virtual Scenario-based Testing of Autonomous Vehicles
This work addresses safety concerns for autonomous vehicle developers by providing a testing framework, but it is incremental as it builds on existing scenario-based testing approaches.
The paper tackles the problem of testing autonomous vehicles (AVs) safely by introducing ViSTA, a framework for virtual scenario-based testing, which generates and executes test cases to identify safety issues before real-world deployment.
In this paper, we present ViSTA, a framework for Virtual Scenario-based Testing of Autonomous Vehicles (AV), developed as part of the 2021 IEEE Autonomous Test Driving AI Test Challenge. Scenario-based virtual testing aims to construct specific challenges posed for the AV to overcome, albeit in virtual test environments that may not necessarily resemble the real world. This approach is aimed at identifying specific issues that arise safety concerns before an actual deployment of the AV on the road. In this paper, we describe a comprehensive test case generation approach that facilitates the design of special-purpose scenarios with meaningful parameters to form test cases, both in automated and manual ways, leveraging the strength and weaknesses of either. Furthermore, we describe how to automate the execution of test cases, and analyze the performance of the AV under these test cases.