AICLApr 8

How Much LLM Does a Self-Revising Agent Actually Need?

arXiv:2604.0723628.4
AI Analysis

This work addresses a methodological gap for researchers in AI and agent design by making latent agent behavior inspectable, though it is incremental as it focuses on a specific domain (Collaborative Battleship) without broad SOTA claims.

The paper tackled the problem of isolating the contributions of LLMs versus explicit structure in self-revising agents by introducing a declared reflective runtime protocol, and found that explicit world-model planning improved win rates by 24.1 percentage points and F1 by 0.017, while adding LLM revision at 4.3% of turns only slightly increased F1 by 0.005 and decreased win rates from 31 to 29 out of 54 games.

Recent LLM-based agents often place world modeling, planning, and reflection inside a single language model loop. This can produce capable behavior, but it makes a basic scientific question difficult to answer: which part of the agent's competence actually comes from the LLM, and which part comes from explicit structure around it? We study this question not by claiming a general answer, but by making it empirically tractable. We introduce a declared reflective runtime protocol that externalizes agent state, confidence signals, guarded actions, and hypothetical transitions into inspectable runtime structure. We instantiate this protocol in a declarative runtime and evaluate it on noisy Collaborative Battleship [4] using four progressively structured agents over 54 games (18 boards $\times$ 3 seeds). The resulting decomposition isolates four components: posterior belief tracking, explicit world-model planning, symbolic in-episode reflection, and sparse LLM-based revision. Across this decomposition, explicit world-model planning improves substantially over a greedy posterior-following baseline (+24.1pp win rate, +0.017 F1). Symbolic reflection operates as a real runtime mechanism -- with prediction tracking, confidence gating, and guarded revision actions -- even though its current revision presets are not yet net-positive in aggregate. Adding conditional LLM revision at about 4.3\% of turns yields only a small and non-monotonic change: average F1 rises slightly (+0.005) while win rate drops (31$\rightarrow$29 out of 54). These results suggest a methodological contribution rather than a leaderboard claim: externalizing reflection turns otherwise latent agent behavior into inspectable runtime structure, allowing the marginal role of LLM intervention to be studied directly.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes