Confidence Calibration in Vision-Language-Action Models
This addresses the need for trustworthy robot behavior by enabling reliable uncertainty quantification in VLA models, representing an incremental advancement in calibration techniques for a specific domain.
The study tackled the problem of confidence calibration in vision-language-action (VLA) models for robots, finding that task performance and calibration are not in tension and introducing methods like prompt ensembles and action-wise Platt scaling to improve calibration, with consistent gains demonstrated across datasets.
Trustworthy robot behavior requires not only high levels of task success but also that the robot can reliably quantify how likely it is to succeed. To this end, we present the first systematic study of confidence calibration in vision-language-action (VLA) foundation models, which map visual observations and natural-language instructions to low-level robot motor commands. We begin with extensive benchmarking to understand the critical relationship between task success and calibration error across multiple datasets and VLA variants, finding that task performance and calibration are not in tension. Next, we introduce prompt ensembles for VLAs, a lightweight, Bayesian-inspired algorithm that averages confidence across paraphrased instructions and consistently improves calibration. We further analyze calibration over the task time horizon, showing that confidence is often most reliable after making some progress, suggesting natural points for risk-aware intervention. Finally, we reveal differential miscalibration across action dimensions and propose action-wise Platt scaling, a method to recalibrate each action dimension independently to produce better confidence estimates. Our aim in this study is to begin to develop the tools and conceptual understanding necessary to render VLAs both highly performant and highly trustworthy via reliable uncertainty quantification.