CVAIJul 16

VTM-Nav: Hierarchical Visual-Topological Memory for Cross-Episode Object-Goal Navigation

arXiv:2607.145147.9h-index: 7
Predicted impact top 54% in CV · last 90 daysOriginality Incremental advance
AI Analysis

For embodied AI researchers, this work enables persistent navigation in repeated environments without retraining, addressing a practical limitation of episodic protocols.

VTM-Nav introduces a training-free, hierarchical visual-topological memory for cross-episode object-goal navigation, achieving state-of-the-art performance on HM3D v0.1, HM3D v0.2, and MP3D benchmarks by reusing scene experience without model updates.

Object-goal navigation requires an embodied agent to locate and reach an instance of a specified object category in an indoor environment. Recent training-free approaches leverage vision-language models (VLMs) for open-vocabulary semantic reasoning, but are typically evaluated under an episodic protocol that resets all scene-specific state after each episode. We introduce Cross-Episode Object-Goal Navigation, in which an agent repeatedly operates in the same scene, retains only self-acquired experience, and keeps its model parameters fixed. To support experience reuse, we present \method, a training-free VLM navigation framework with a persistent hierarchical Visual-Topological Memory (VTM). The VTM organizes scene knowledge at room and object levels and retrieves relevant experience through coarse-to-fine matching, providing memory as soft guidance only when it agrees with current observations. A conservative execution guard further mitigates oscillations, blocked motions, and premature stopping. Under a controlled same-scene protocol, we evaluate \method{} on three benchmarks, HM3D v0.1, HM3D v0.2, and MP3D, and compare it with a strengthened WMNav baseline augmented with cross-episode textual memory, while keeping the VLM backbone and action pipeline identical. \method{} achieves the best performance across all three benchmarks, demonstrating the effectiveness and robustness of structured visual-topological experience reuse across datasets.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes