Model-free generalized fiducial inference
This work addresses a limitation in uncertainty quantification for researchers and practitioners using CP, offering a theoretical extension that synthesizes connections with other contemporary methods, though it appears incremental in nature.
The paper tackles the lack of versatility in conformal prediction (CP) for quantifying evidence in support of arbitrary events, by connecting CP to generalized fiducial (GF) inference using imprecise probability theory, resulting in a more general inferential framework that enables prescriptive, posterior-like inference not possible with CP alone.
Conformal prediction (CP) was developed to provide finite-sample probabilistic prediction guarantees. While CP algorithms are a relatively general-purpose approach to uncertainty quantification, with finite-sample guarantees, they lack versatility. Namely, the CP approach does not {\em prescribe} how to quantify the degree to which a data set provides evidence in support of (or against) an arbitrary event from a general class of events. In this paper, tools are offered from imprecise probability theory to build a formal connection between CP and generalized fiducial (GF) inference. These new insights establish a more general inferential lens from which CP can be understood, and demonstrate the pragmatism of fiducial ideas. The formal connection establishes a context in which epistemically-derived GF probability matches aleatoric/frequentist probability. Beyond this fact, it is illustrated how tools from imprecise probability theory, namely lower and upper probability functions, can be applied in the context of the imprecise GF distribution to provide posterior-like, prescriptive inference that is not possible within the CP framework alone. In addition to the primary CP generalization that is contributed, fundamental connections are synthesized between this new model-free GF and three other areas of contemporary research: nonparametric predictive inference (NPI), conformal predictive systems/distributions, and inferential models (IMs).