Internal Representation, Not Clinical Knowledge: Where Apparent LLM Triage Failures Originate
For developers and users of LLMs in clinical triage, this work clarifies that apparent knowledge gaps are actually format-induced errors, shifting focus from model training to output interface design.
The paper shows that LLM triage failures in multiple-choice benchmarks are caused by output format artifacts, not by lack of clinical knowledge. Multiple methods (SAE features, logit attribution, behavioral tests) confirm that medical features are preserved but format features dominate decision logits, with most errors being off-by-one rather than knowledge failures.
Patient-voiced clinical-triage benchmarks report high under-triage rates for consumer LLMs for constrained multiple-choice output, yet the same cases score differently with free-text. We ask whether output format changes the model's \emph{clinical representation} or only the mapping from a preserved representation to an answer. Using sparse-autoencoder (SAE) features in Gemma 3 4B/12B IT and Qwen3-8B, we find the same medical features fire on the shared clinical narrative under both formats but go {silent} at the multiple-choice decision token in all the cases at every model. Three independent methods (natural-language autoencoder verbalization, decision-token logit attribution, and top-feature characterization) agree that scaffold and format features, but not medical features, drive the decision logits. Behaviorally, the multiple-choice penalty inverts under both structured and natural-language input, option-order shuffle rules out positional bias, and the gap is dominated by off-by-one decision (the model picks an adjacent acuity letter to the gold answer) rather than knowledge failure. Thus, the failure originates in the output format and not in the clinical representation.