Event-based Photometric Stereo via Rotating Illumination and Per-Pixel Learning
This work addresses real-world photometric stereo challenges for applications requiring robustness to ambient light and dynamic conditions, though it is incremental as it builds on prior event-based approaches.
The paper tackles the limitations of conventional photometric stereo by proposing an event-based system using a rotating light source and per-pixel neural networks, achieving a 7.12% reduction in mean angular error compared to existing event-based methods.
Photometric stereo is a technique for estimating surface normals using images captured under varying illumination. However, conventional frame-based photometric stereo methods are limited in real-world applications due to their reliance on controlled lighting, and susceptibility to ambient illumination. To address these limitations, we propose an event-based photometric stereo system that leverages an event camera, which is effective in scenarios with continuously varying scene radiance and high dynamic range conditions. Our setup employs a single light source moving along a predefined circular trajectory, eliminating the need for multiple synchronized light sources and enabling a more compact and scalable design. We further introduce a lightweight per-pixel multi-layer neural network that directly predicts surface normals from event signals generated by intensity changes as the light source rotates, without system calibration. Experimental results on benchmark datasets and real-world data collected with our data acquisition system demonstrate the effectiveness of our method, achieving a 7.12\% reduction in mean angular error compared to existing event-based photometric stereo methods. In addition, our method demonstrates robustness in regions with sparse event activity, strong ambient illumination, and scenes affected by specularities.