Softmax is not Enough (for Adaptive Conformal Classification)
This work addresses the limitation of softmax-based uncertainty in conformal prediction for deep learning, offering a method to enhance adaptiveness without added complexity, which is incremental but impactful for uncertainty quantification in AI.
The paper tackled the problem of unreliable uncertainty quantification in deep conformal classifiers by proposing an energy-based enhancement to nonconformity scores, resulting in improved adaptiveness and efficiency of prediction sets across multiple datasets and architectures.
The merit of Conformal Prediction (CP), as a distribution-free framework for uncertainty quantification, depends on generating prediction sets that are efficient, reflected in small average set sizes, while adaptive, meaning they signal uncertainty by varying in size according to input difficulty. A central limitation for deep conformal classifiers is that the nonconformity scores are derived from softmax outputs, which can be unreliable indicators of how certain the model truly is about a given input, sometimes leading to overconfident misclassifications or undue hesitation. In this work, we argue that this unreliability can be inherited by the prediction sets generated by CP, limiting their capacity for adaptiveness. We propose a new approach that leverages information from the pre-softmax logit space, using the Helmholtz Free Energy as a measure of model uncertainty and sample difficulty. By reweighting nonconformity scores with a monotonic transformation of the energy score of each sample, we improve their sensitivity to input difficulty. Our experiments with four state-of-the-art score functions on multiple datasets and deep architectures show that this energy-based enhancement improves the adaptiveness of the prediction sets, leading to a notable increase in both efficiency and adaptiveness compared to baseline nonconformity scores, without introducing any post-hoc complexity.