Creating Visual Effects with Neural Radiance Fields
This work addresses the problem of integrating NeRFs into VFX workflows for film and visual effects professionals, representing an incremental improvement by adapting existing tools.
The paper tackles the integration of Neural Radiance Fields (NeRFs) into traditional visual effects (VFX) pipelines by presenting a pipeline using Nerfstudio and Blender to align camera paths and composite NeRF renders with meshes and other effects, enabling seamless use in film production.
We present a pipeline for integrating NeRFs into traditional compositing VFX pipelines using Nerfstudio, an open-source framework for training and rendering NeRFs. Our approach involves using Blender, a widely used open-source 3D creation software, to align camera paths and composite NeRF renders with meshes and other NeRFs, allowing for seamless integration of NeRFs into traditional VFX pipelines. Our NeRF Blender add-on allows for more controlled camera trajectories of photorealistic scenes, compositing meshes and other environmental effects with NeRFs, and compositing multiple NeRFs in a single scene.This approach of generating NeRF aligned camera paths can be adapted to other 3D tool sets and workflows, enabling a more seamless integration of NeRFs into visual effects and film production. Documentation can be found here: https://docs.nerf.studio/extensions/blender_addon.html