Continuous and Resource Managed Regression Testing: An Industrial Use Case
This addresses resource management in regression testing for embedded industrial domains, but it is incremental as it builds on existing prioritization techniques.
The paper tackled the high cost and time of regression testing in embedded systems by using test case prioritization and selection to run more important tests earlier, achieving validation with 5-25 test cases (0.4%-2.0% of 1254).
Regression testing is an important part of quality control in both software and embedded products, where hardware is involved. It is also one of the most expensive and time consuming part of the product cycle. To improve the cost effectiveness of the development cycle and the regression testing, we use test case prioritisation and selection techniques to run more important test cases earlier in the testing process. In this paper, we consider a functional test case prioritisation with an access only to the version control of the codebase and regression history. Prioritisation is used to aid our test case selection, where we have chosen 5-25 (0.4%-2.0% of 1254) test cases to validate our method. The selection technique together with other prioritisation methods allows us to shape the current static, retest-all regression testing into a more resource managed regression testing framework. This framework will serve the agile way of working better and will allow us to allocate testing resources more wisely. This is a joint work with a large international Finnish company in an embedded industrial domain.