EditCast3D: Single-Frame-Guided 3D Editing with Video Propagation and View Selection
It addresses the problem of scalable and efficient 3D editing for researchers and practitioners by reducing reliance on costly iterative methods, though it is incremental as it builds on existing workflows with novel optimizations.
The paper tackles the challenge of extending foundation models to 3D editing by proposing EditCast3D, a pipeline that uses video generation models to propagate edits from a single frame and employs view selection for consistency, resulting in superior editing quality and high efficiency compared to state-of-the-art baselines.
Recent advances in foundation models have driven remarkable progress in image editing, yet their extension to 3D editing remains underexplored. A natural approach is to replace the image editing modules in existing workflows with foundation models. However, their heavy computational demands and the restrictions and costs of closed-source APIs make plugging these models into existing iterative editing strategies impractical. To address this limitation, we propose EditCast3D, a pipeline that employs video generation foundation models to propagate edits from a single first frame across the entire dataset prior to reconstruction. While editing propagation enables dataset-level editing via video models, its consistency remains suboptimal for 3D reconstruction, where multi-view alignment is essential. To overcome this, EditCast3D introduces a view selection strategy that explicitly identifies consistent and reconstruction-friendly views and adopts feedforward reconstruction without requiring costly refinement. In combination, the pipeline both minimizes reliance on expensive image editing and mitigates prompt ambiguities that arise when applying foundation models independently across images. We evaluate EditCast3D on commonly used 3D editing datasets and compare it against state-of-the-art 3D editing baselines, demonstrating superior editing quality and high efficiency. These results establish EditCast3D as a scalable and general paradigm for integrating foundation models into 3D editing pipelines. The code is available at https://github.com/UNITES-Lab/EditCast3D