LGAIJun 30

ECHO: Prune to act, trace to learn with selective turn memory in agentic RL

arXiv:2606.3165024.1
Predicted impact top 1% in LG · last 90 daysOriginality Highly original
AI Analysis

For developers of long-horizon language agents, ECHO provides a method to maintain fine-grained evidence access and improve RL credit assignment under bounded context windows.

ECHO introduces a selective turn-memory framework for long-horizon language agents that addresses history collapse and enables traceable RL credit assignment. On BrowseComp-Plus, it achieves 43.4% held-out accuracy, outperforming GRPO (28.9%) and SUPO (36.1%) with fewer turns.

Long-horizon language agents must repeatedly interact with tools, accumulate evidence, and make decisions under bounded context windows. Existing context-management methods make such rollouts feasible by truncating distant history, folding past turns into summaries, or selecting compact memory states. However, these breakthroughs introduce two coupled limitations. First, as the number of turns grows, historical observations are progressively removed or collapsed into compressed states, making it harder for the policy to reuse fine-grained evidence. Second, once the original turns are no longer source-addressable, outcome-based RL loses an explicit path for aligning policy updates with the evidence that supported a successful final answer. To this end, we propose ECHO, a selective turn-memory framework that jointly addresses history collapse and traceable learning through source-indexed reconstruction. Specifically, ECHO compresses each completed environment turn into a compact memory record, reconstructs bounded policy contexts by selecting from these records, and reuses the selected source indices to route positive outcome credit to the evidence and selection actions that support successful answers. On BrowseComp-Plus, ECHO reaches 43.4% held-out accuracy, outperforming GRPO (28.9%) and the rolling-summary baseline SUPO (36.1%), while using fewer turns and lower trajectory volume than SUPO (Figure 1). Additionally, the trained policy improves zero-shot generalization across multi-objective QA, code generation, and deep information-seeking benchmarks on both dense and MoE backbones.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes