MultiBARF: Integrating Imagery of Different Wavelength Regions by Using Neural Radiance Fields
This work addresses the challenge of data preparation for multi-sensor applications, making it easier for users without sensing expertise, though it appears incremental as it extends an existing method.
The paper tackles the problem of combining images from different sensors by developing MultiBARF, which synthesizes pairs of sensor and depth images at assigned viewpoints, eliminating the need for co-registration and geometric calibration. Through experiments with visible light and thermographic images, the method successfully superimposes two color channels on Neural Radiance Fields.
Optical sensor applications have become popular through digital transformation. Linking observed data to real-world locations and combining different image sensors is essential to make the applications practical and efficient. However, data preparation to try different sensor combinations requires high sensing and image processing expertise. To make data preparation easier for users unfamiliar with sensing and image processing, we have developed MultiBARF. This method replaces the co-registration and geometric calibration by synthesizing pairs of two different sensor images and depth images at assigned viewpoints. Our method extends Bundle Adjusting Neural Radiance Fields(BARF), a deep neural network-based novel view synthesis method, for the two imagers. Through experiments on visible light and thermographic images, we demonstrate that our method superimposes two color channels of those sensor images on NeRF.