ReCoGS: Real-time ReColoring for Gaussian Splatting scenes
This work addresses the need for fine-grained control in 3D scene editing for users, though it is incremental as it focuses specifically on recoloring within an existing framework.
The paper tackles the problem of recoloring regions in Gaussian Splatting scenes, introducing a user-friendly pipeline that enables precise selection and real-time interactive editing.
Gaussian Splatting has emerged as a leading method for novel view synthesis, offering superior training efficiency and real-time inference compared to NeRF approaches, while still delivering high-quality reconstructions. Beyond view synthesis, this 3D representation has also been explored for editing tasks. Many existing methods leverage 2D diffusion models to generate multi-view datasets for training, but they often suffer from limitations such as view inconsistencies, lack of fine-grained control, and high computational demand. In this work, we focus specifically on the editing task of recoloring. We introduce a user-friendly pipeline that enables precise selection and recoloring of regions within a pre-trained Gaussian Splatting scene. To demonstrate the real-time performance of our method, we also present an interactive tool that allows users to experiment with the pipeline in practice. Code is available at https://github.com/loryruta/recogs.