Towards an Automated Unified Framework to Run Applications for Combinatorial Interaction Testing
This work provides a practical tool for software testing in industrial settings, though it is incremental as it builds on existing open-source frameworks.
The authors tackled the need for industrial experience in combinatorial interaction testing (CIT) by developing a unified framework based on Avocado for generating, executing, and verifying test suites, and demonstrated its effectiveness in detecting configuration failures in a virtualization system.
Combinatorial interaction testing (CIT) is a well-known technique, but the industrial experience is needed to determine its effectiveness in different application domains. We present a case study introducing a unified framework for generating, executing and verifying CIT test suites, based on the open-source Avocado test framework. In addition, we present a new industrial case study to demonstrate the effectiveness of the framework. This evaluation showed that the new framework can generate, execute, and verify effective combinatorial interaction test suites for detecting configuration failures (invalid configurations) in a virtualization system.