Robust and Real-time Surface Normal Estimation from Stereo Disparities using Affine Transformations
This work addresses the problem of real-time 3D reconstruction for robotics or autonomous systems, but it is incremental as it builds on existing stereo disparity methods with custom optimizations.
The paper tackles surface normal estimation from stereo images by using affine transformations from disparities, achieving faster and accurate results with real-time GPU performance validated on Middlebury and Cityscapes datasets.
This work introduces a novel method for surface normal estimation from rectified stereo image pairs, leveraging affine transformations derived from disparity values to achieve fast and accurate results. We demonstrate how the rectification of stereo image pairs simplifies the process of surface normal estimation by reducing computational complexity. To address noise reduction, we develop a custom algorithm inspired by convolutional operations, tailored to process disparity data efficiently. We also introduce adaptive heuristic techniques for efficiently detecting connected surface components within the images, further improving the robustness of the method. By integrating these methods, we construct a surface normal estimator that is both fast and accurate, producing a dense, oriented point cloud as the final output. Our method is validated using both simulated environments and real-world stereo images from the Middlebury and Cityscapes datasets, demonstrating significant improvements in real-time performance and accuracy when implemented on a GPU. Upon acceptance, the shader source code will be made publicly available to facilitate further research and reproducibility.