CVJan 23, 2021

Fixed Viewpoint Mirror Surface Reconstruction under an Uncalibrated Camera

arXiv:2101.09392v15 citations
AI Analysis

This method simplifies mirror reconstruction for applications like computer vision by eliminating calibration steps, though it is incremental as it builds on existing reflection-based approaches.

The paper tackles mirror surface reconstruction by observing reflections of a moving reference plane, enabling recovery of camera intrinsics, plane poses, and the mirror surface without tedious calibration, achieving accurate results on synthetic and real data.

This paper addresses the problem of mirror surface reconstruction, and proposes a solution based on observing the reflections of a moving reference plane on the mirror surface. Unlike previous approaches which require tedious calibration, our method can recover the camera intrinsics, the poses of the reference plane, as well as the mirror surface from the observed reflections of the reference plane under at least three unknown distinct poses. We first show that the 3D poses of the reference plane can be estimated from the reflection correspondences established between the images and the reference plane. We then form a bunch of 3D lines from the reflection correspondences, and derive an analytical solution to recover the line projection matrix. We transform the line projection matrix to its equivalent camera projection matrix, and propose a cross-ratio based formulation to optimize the camera projection matrix by minimizing reprojection errors. The mirror surface is then reconstructed based on the optimized cross-ratio constraint. Experimental results on both synthetic and real data are presented, which demonstrate the feasibility and accuracy of our method.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes