CLMay 9

Decomposing and Steering Functional Metacognition in Large Language Models

arXiv:2605.0894296.7Has Code
Predicted impact top 7% in CL · last 90 daysOriginality Highly original
AI Analysis

Provides a mechanistic framework for understanding and controlling internal metacognitive states in LLMs, which is essential for reliable evaluation and deployment.

LLMs have a decomposable space of functional metacognitive states (evaluation awareness, self-assessed capability, etc.) that are linearly decodable from internal activations and causally modulate reasoning behavior. Steering these states affects verbosity, accuracy, and safety responses.

Large language models (LLMs) increasingly exhibit behaviors suggesting awareness of their evaluation context, often adapting their reasoning strategies in benchmark settings. Prior work has shown that such evaluation awareness can distort performance measurements; however, it remains unclear whether this phenomenon reflects a single behavioral artifact or a deeper internal structure within the model. We propose that LLMs maintain a decomposable space of functional metacognitive states: internal variables encoding factors such as evaluation awareness, self-assessed capability, perceived risk, computational effort allocation, audience expertise adaptation, and intentionality. Through residual stream analysis across multiple reasoning models, we demonstrate that these states are linearly decodable from internal activations and exhibit distinct layer-wise profiles. Moreover, by steering model activations along probe-derived directions, we show that each functional metacognitive state causally modulates reasoning behavior in dissociable ways, affecting verbosity, accuracy, and safety-related responses across tasks. Our findings suggest that benchmark performance reflects not only task competence but also the activation of specific functional metacognitive states. We argue that understandi ng and controlling these internal states is essential for reliable evaluation and deployment of reasoning models, and we provide a mechanistic framework for studying functional m etacognition in artificial systems. Our code and data are publicly available at https://github.com/xlands/meta-cognition.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes