STEER: Inference-Time Risk Control via Constrained Quality-Diversity Search
This addresses the need for adjustable risk control in safety-critical applications like healthcare, offering a novel approach to steer LLM behavior without retraining.
The paper tackles the problem of LLMs exhibiting narrow decision behaviors in ordinal settings like clinical triage by proposing STEER, a training-free framework that uses constrained quality-diversity search to enable tunable risk control, achieving broader behavioral coverage and maintaining high accuracy on urgent cases compared to baseline methods.
Large Language Models (LLMs) trained for average correctness often exhibit mode collapse, producing narrow decision behaviors on tasks where multiple responses may be reasonable. This limitation is particularly problematic in ordinal decision settings such as clinical triage, where standard alignment removes the ability to trade off specificity and sensitivity (the ROC operating point) based on contextual constraints. We propose STEER (Steerable Tuning via Evolutionary Ensemble Refinement), a training-free framework that reintroduces this tunable control. STEER constructs a population of natural-language personas through an offline, constrained quality-diversity search that promotes behavioral coverage while enforcing minimum safety, reasoning, and stability thresholds. At inference time, STEER exposes a single, interpretable control parameter that maps a user-specified risk percentile to a selected persona, yielding a monotonic adjustment of decision conservativeness. On two clinical triage benchmarks, STEER achieves broader behavioral coverage compared to temperature-based sampling and static persona ensembles. Compared to a representative post-training method, STEER maintains substantially higher accuracy on unambiguous urgent cases while providing comparable control over ambiguous decisions. These results demonstrate STEER as a safety-preserving paradigm for risk control, capable of steering behavior without compromising domain competence.