IVCVNov 17, 2023

Phase Guided Light Field for Spatial-Depth High Resolution 3D Imaging

arXiv:2311.10568v21 citationsh-index: 17
AI Analysis

This improves 3D imaging for applications like robotics or inspection by enhancing resolution with minimal data, though it is incremental as it builds on active light field methods.

The paper tackled the low spatial resolution and depth accuracy of single-shot light field cameras by proposing a phase guided light field algorithm using projected high-frequency phase-shifted patterns, achieving a spatial resolution of 1280×720 with a 10× increase factor while maintaining high depth resolution.

On 3D imaging, light field cameras typically are of single shot, and however, they heavily suffer from low spatial resolution and depth accuracy. In this paper, by employing an optical projector to project a group of single high-frequency phase-shifted sinusoid patterns, we propose a phase guided light field algorithm to significantly improve both the spatial and depth resolutions for off-the-shelf light field cameras. First, for correcting the axial aberrations caused by the main lens of our light field camera, we propose a deformed cone model to calibrate our structured light field system. Second, over wrapped phases computed from patterned images, we propose a stereo matching algorithm, i.e. phase guided sum of absolute difference, to robustly obtain the correspondence for each pair of neighbored two lenslets. Finally, by introducing a virtual camera according to the basic geometrical optics of light field imaging, we propose a reorganization strategy to reconstruct 3D point clouds with spatial-depth high resolution. Experimental results show that, compared with the state-of-the-art active light field methods, the proposed reconstructs 3D point clouds with a spatial resolution of 1280$\times$720 with factors 10$\times$ increased, while maintaining the same high depth resolution and needing merely a single group of high-frequency patterns.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes