A post-selection algorithm for improving dynamic ensemble selection methods
This is an incremental improvement for multiple classifier systems, addressing variability in DES performance across different problems.
The authors tackled the problem of no single Dynamic Ensemble Selection (DES) method being universally best by proposing PS-DES, a post-selection scheme that selects the best DES approach per query instance, which improved accuracy over individual DES techniques.
Dynamic Ensemble Selection (DES) is a Multiple Classifier Systems (MCS) approach that aims to select an ensemble for each query sample during the selection phase. Even with the proposal of several DES approaches, no particular DES technique is the best choice for different problems. Thus, we hypothesize that selecting the best DES approach per query instance can lead to better accuracy. To evaluate this idea, we introduce the Post-Selection Dynamic Ensemble Selection (PS-DES) approach, a post-selection scheme that evaluates ensembles selected by several DES techniques using different metrics. Experimental results show that using accuracy as a metric to select the ensembles, PS-DES performs better than individual DES techniques. PS-DES source code is available in a GitHub repository