Let it Snow! Animating Static Gaussian Scenes With Dynamic Weather Effects
This work addresses the problem of enhancing static 3D scene reconstructions with interactive dynamic elements for applications in computer graphics and simulation, representing an incremental advancement in hybrid rendering techniques.
The paper tackles the challenge of adding dynamic weather effects like snowfall and rainfall to static 3D Gaussian Splatting scenes, achieving significant improvements in visual quality and physical realism over existing methods.
3D Gaussian Splatting has recently enabled fast and photorealistic reconstruction of static 3D scenes. However, introducing dynamic elements that interact naturally with such static scenes remains challenging. Accordingly, we present a novel hybrid framework that combines Gaussian-particle representations for incorporating physically-based global weather effects into static 3D Gaussian Splatting scenes, correctly handling the interactions of dynamic elements with the static scene. We follow a three-stage process: we first map static 3D Gaussians to a particle-based representation. We then introduce dynamic particles and simulate their motion using the Material Point Method (MPM). Finally, we map the simulated particles back to the Gaussian domain while introducing appearance parameters tailored for specific effects. To correctly handle the interactions of dynamic elements with the static scene, we introduce specialized collision handling techniques. Our approach supports a variety of weather effects, including snowfall, rainfall, fog, and sandstorms, and can also support falling objects, all with physically plausible motion and appearance. Experiments demonstrate that our method significantly outperforms existing approaches in both visual quality and physical realism.