ROJul 15

COLMAR: Cooperative View Policy Learning for Multi-Agent Active 3D Reconstruction

arXiv:2607.135246.7h-index: 6
Predicted impact top 53% in RO · last 90 daysOriginality Incremental advance
AI Analysis

This work addresses coordination inefficiencies in multi-agent active 3D reconstruction, offering a practical solution for teams of agents with limited sensing budgets.

COLMAR introduces a cooperative view policy learning framework for multi-agent active 3D reconstruction, achieving up to 54% higher reconstruction accuracy and 49% greater coverage compared to baselines on GLEAM and Replica datasets.

Active 3D reconstruction requires selecting informative viewpoints under limited sensing budgets. In multi-agent settings, coordination inefficiencies such as redundant observations and spatial clustering can significantly reduce reconstruction quality. We present COLMAR, a cooperative view policy learning framework for multi-agent active 3D reconstruction. COLMAR formulates viewpoint allocation as a shared policy optimization over map-centric observations and introduces a reconstruction-aware objective that promotes overlap-aware coverage, team-level discovery, and collision-safe exploration. Dense feedback derived from incremental reconstruction updates aligns exploration behavior with downstream geometric quality. The policy is trained using parameter-sharing Proximal Policy Optimization (PPO) with independent per-agent action selection at deployment, conditioned on a fused team map and without inter-agent message passing for decision making. Selected viewpoints are then reconstructed with 3D Gaussian Splatting (3DGS) for high-fidelity photometric evaluation. Experiments on GLEAM and Replica demonstrate consistent improvements over heuristic and non-cooperative baselines, achieving up to 54% higher reconstruction accuracy and 49% greater coverage under matched sensing budgets.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes