A Taxonomy of Data Quality Challenges in Empirical Software Engineering
This work addresses data quality challenges for researchers and practitioners in empirical software engineering, but it is incremental as it synthesizes existing knowledge into a taxonomy.
The paper tackles the problem of data quality in empirical software engineering by proposing a taxonomy based on a review of prior research, classifying issues into three areas including data fitness, model suitability, and accessibility/trust.
Reliable empirical models such as those used in software effort estimation or defect prediction are inherently dependent on the data from which they are built. As demands for process and product improvement continue to grow, the quality of the data used in measurement and prediction systems warrants increasingly close scrutiny. In this paper we propose a taxonomy of data quality challenges in empirical software engineering, based on an extensive review of prior research. We consider current assessment techniques for each quality issue and proposed mechanisms to address these issues, where available. Our taxonomy classifies data quality issues into three broad areas: first, characteristics of data that mean they are not fit for modeling; second, data set characteristics that lead to concerns about the suitability of applying a given model to another data set; and third, factors that prevent or limit data accessibility and trust. We identify this latter area as of particular need in terms of further research.