Volumetric Inverse Rendering via Neural Radiative Transfer
It provides a practical method for recovering full optical properties of participating media from images, enabling physically based reconstruction and generative modeling with global illumination.
This work proposes a neural radiative transfer formulation for volumetric inverse rendering that recovers spatially varying scattering, absorption, and phase function parameters from multi-view images while accounting for global illumination, achieving physically accurate reconstruction without differentiable light transport simulation.
Volumetric inverse rendering seeks to recover the optical properties of participating media from images. Existing approaches either rely on differentiable stochastic light transport simulation, which require substantial algorithmic effort, or use simplified models that fail to capture global illumination. We propose a formulation that reconciles physically complete light transport with general-purpose neural optimization. The optical properties of the medium and the full light field are represented as neural fields and estimated through a joint optimization process. Global illumination is enforced via a residual objective derived from the Radiative Transfer Equation in local differential form, complemented by a volume rendering term along primary viewing rays to mitigate \rev{low-frequency} bias. We demonstrate reconstruction of spatially varying, color-resolved scattering, absorption, and phase function parameters from multi-view images. Beyond reconstruction, the same framework supports learning generative models of participating media with physical optical properties under global illumination.