Best Practices in Active Learning for Semantic Segmentation
This work addresses the problem of costly annotations in semantic segmentation for domains like driving and medical applications, offering practical guidance, though it is incremental as it synthesizes existing methods.
The study investigated active learning methods for semantic segmentation under varying conditions like data redundancy and labeling budgets, finding that these factors critically influence method selection and providing a usage guide for optimal performance.
Active learning is particularly of interest for semantic segmentation, where annotations are costly. Previous academic studies focused on datasets that are already very diverse and where the model is trained in a supervised manner with a large annotation budget. In contrast, data collected in many driving scenarios is highly redundant, and most medical applications are subject to very constrained annotation budgets. This work investigates the various types of existing active learning methods for semantic segmentation under diverse conditions across three dimensions - data distribution w.r.t. different redundancy levels, integration of semi-supervised learning, and different labeling budgets. We find that these three underlying factors are decisive for the selection of the best active learning approach. As an outcome of our study, we provide a comprehensive usage guide to obtain the best performance for each case. We also propose an exemplary evaluation task for driving scenarios, where data has high redundancy, to showcase the practical implications of our research findings.