ROJun 29

Analytic Concept-Centric Memory for Agentic Embodied Manipulation

arXiv:2606.2977416.7
Predicted impact top 11% in RO · last 90 daysOriginality Incremental advance
AI Analysis

For embodied AI agents performing long-horizon manipulation tasks, this work addresses the bottleneck of memory organization and retrieval for reusing prior interaction knowledge.

The paper introduces an analytic concept-centric memory framework for embodied manipulation that organizes experience around structured concepts (semantic parts, parametric templates, grounded poses, affordances, manipulation states) and connects object/scene memories with transition and skill memories. Experiments show improvements in task completion, retrieval accuracy, object re-identification, and cross-object skill generalization over unstructured and embedding-based baselines.

Long-horizon embodied manipulation requires agents to remember persistent objects, track changing scene states, and reuse prior interaction knowledge. However, existing agent memories are often stored as unstructured histories or embedding-based records, making it difficult to retrieve manipulation-relevant object parts, physical states, action effects, and executable skills. We propose an analytic concept-centric memory framework for agentic embodied manipulation. Our memory organizes experience around structured analytic concepts, where objects are represented by semantic parts, parametric templates, grounded poses, affordances, and manipulation states. It further connects object and scene memories with transition memory for action-induced state changes and skill memory for template-grounded and policy-grounded execution. At runtime, the agent performs structured coarse-to-fine retrieval to identify relevant objects, states, transitions, and skills, supporting state-consistent reasoning and skill reuse. Experiments on memory-dependent manipulation, articulated-object generalization, real-world memory evaluation, and ablations show that our approach improves task completion, retrieval accuracy, object re-identification, and cross-object skill generalization over unstructured and embedding-based memory baselines.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes