Photometric single-view dense 3D reconstruction in endoscopy
This enables computer-assisted navigation in endoscopy by providing the first in-vivo 3D reconstruction of the human colon, addressing the lack of true scale in monocular systems.
The paper tackled the problem of achieving true-scale 3D reconstruction in endoscopy using monocular images by exploiting controlled lighting for photometric stereo, resulting in a mean depth estimation error of 7% (below 3 mm on average) in simulated colonoscopies.
Visual SLAM inside the human body will open the way to computer-assisted navigation in endoscopy. However, due to space limitations, medical endoscopes only provide monocular images, leading to systems lacking true scale. In this paper, we exploit the controlled lighting in colonoscopy to achieve the first in-vivo 3D reconstruction of the human colon using photometric stereo on a calibrated monocular endoscope. Our method works in a real medical environment, providing both a suitable in-place calibration procedure and a depth estimation technique adapted to the colon's tubular geometry. We validate our method on simulated colonoscopies, obtaining a mean error of 7% on depth estimation, which is below 3 mm on average. Our qualitative results on the EndoMapper dataset show that the method is able to correctly estimate the colon shape in real human colonoscopies, paving the ground for true-scale monocular SLAM in endoscopy.