Conformalized Regression for Continuous Bounded Outcomes
This work addresses a specific challenge in statistical and machine learning applications involving bounded outcomes, offering a practical solution for interval prediction, though it is incremental as it builds on existing conformal prediction frameworks.
The paper tackles the problem of predicting bounded continuous outcomes, such as rates and proportions, by developing conformal prediction intervals using transformation models and beta regression, and demonstrates through simulations that the methods provide valid finite-sample predictive coverage even under model misspecification.
Regression problems with bounded continuous outcomes frequently arise in real-world statistical and machine learning applications, such as the analysis of rates and proportions. A central challenge in this setting is predicting a response associated with a new covariate value. Most of the existing statistical and machine learning literature has focused either on point prediction of bounded outcomes or on interval prediction based on asymptotic approximations. We develop conformal prediction intervals for bounded outcomes based on transformation models and beta regression. We introduce tailored non-conformity measures based on residuals that are aligned with the underlying models, and account for the inherent heteroscedasticity in regression settings with bounded outcomes. We present a theoretical result on asymptotic marginal and conditional validity in the context of full conformal prediction, which remains valid under model misspecification. For split conformal prediction, we provide an empirical coverage analysis based on a comprehensive simulation study. The simulation study demonstrates that both methods provide valid finite-sample predictive coverage, including settings with model misspecification. Finally, we demonstrate the practical performance of the proposed conformal prediction intervals on real data and compare them with bootstrap-based alternatives.