SEDec 29, 2016

TDSelector: A Training Data Selection Method for Cross-Project Defect Prediction

arXiv:1612.09065v111 citations
Originality Incremental advance
AI Analysis

This work addresses a specific bottleneck in software engineering for defect prediction, offering an incremental improvement over existing methods.

The paper tackles the problem of poor performance in cross-project defect prediction (CPDP) by proposing TDSelector, a training data selection method that considers both instance similarity and defect counts, resulting in AUC improvements of up to 10.6% and 4.3% compared to baseline methods.

In recent years, cross-project defect prediction (CPDP) attracted much attention and has been validated as a feasible way to address the problem of local data sparsity in newly created or inactive software projects. Unfortunately, the performance of CPDP is usually poor, and low quality training data selection has been regarded as a major obstacle to achieving better prediction results. To the best of our knowledge, most of existing approaches related to this topic are only based on instance similarity. Therefore, the objective of this work is to propose an improved training data selection method for CPDP that considers both similarity and the number of defects each training instance has (denoted by defects), which is referred to as TDSelector, and to demonstrate the effectiveness of the proposed method. Our experiments were conducted on 14 projects (including 15 data sets) collected from two public repositories. The results indicate that, in a specific CPDP scenario, the TDSelector-based bug predictor performs, on average, better than those based on the baseline methods, and the AUC (area under ROC curve) values are increased by up to 10.6 and 4.3%, respectively. Besides, an additional experiment shows that selecting those instances with more bugs directly as training data can further improve the performance of the bug predictor trained by our method.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes