LGAIMLJun 5, 2023

On training locally adaptive CP

arXiv:2306.04648v18 citationsh-index: 9
Originality Incremental advance
AI Analysis

This addresses the need for more efficient and adaptive uncertainty quantification in machine learning, though it appears incremental as it builds on existing CP methods with a novel twist.

The paper tackles the problem of making Conformal Prediction intervals locally adaptive by redefining the conformity measure with a trainable, object-dependent transformation, resulting in prediction intervals that are guaranteed to be marginally valid and have attribute-dependent sizes while enabling smooth gradient-based optimization.

We address the problem of making Conformal Prediction (CP) intervals locally adaptive. Most existing methods focus on approximating the object-conditional validity of the intervals by partitioning or re-weighting the calibration set. Our strategy is new and conceptually different. Instead of re-weighting the calibration data, we redefine the conformity measure through a trainable change of variables, $A \to φ_X(A)$, that depends explicitly on the object attributes, $X$. Under certain conditions and if $φ_X$ is monotonic in $A$ for any $X$, the transformations produce prediction intervals that are guaranteed to be marginally valid and have $X$-dependent sizes. We describe how to parameterize and train $φ_X$ to maximize the interval efficiency. Contrary to other CP-aware training methods, the objective function is smooth and can be minimized through standard gradient methods without approximations.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes