IVCVINS-DETFeb 26, 2019

High Flux Passive Imaging with Single-Photon Sensors

arXiv:1902.10190v276 citations
Originality Highly original
AI Analysis

This enables high dynamic range imaging for applications like microscopy and LiDAR without active lighting, though it is incremental as it builds on existing SPAD technology.

The paper tackles the problem of limited dynamic range in imaging sensors by proposing passive free-running SPAD (PF-SPAD) imaging, which uses single-photon avalanche diodes to capture 2D intensity images under ambient lighting without active sources, achieving an extreme dynamic range of 1,000,000:1 and demonstrating over 2 orders of magnitude improvement over conventional sensors.

Single-photon avalanche diodes (SPADs) are an emerging technology with a unique capability of capturing individual photons with high timing precision. SPADs are being used in several active imaging systems (e.g., fluorescence lifetime microscopy and LiDAR), albeit mostly limited to low photon flux settings. We propose passive free-running SPAD (PF-SPAD) imaging, an imaging modality that uses SPADs for capturing 2D intensity images with unprecedented dynamic range under ambient lighting, without any active light source. Our key observation is that the precise inter-photon timing measured by a SPAD can be used for estimating scene brightness under ambient lighting conditions, even for very bright scenes. We develop a theoretical model for PF-SPAD imaging, and derive a scene brightness estimator based on the average time of darkness between successive photons detected by a PF-SPAD pixel. Our key insight is that due to the stochastic nature of photon arrivals, this estimator does not suffer from a hard saturation limit. Coupled with high sensitivity at low flux, this enables a PF-SPAD pixel to measure a wide range of scene brightness, from very low to very high, thereby achieving extreme dynamic range. We demonstrate an improvement of over 2 orders of magnitude over conventional sensors by imaging scenes spanning a dynamic range of 1,000,000:1.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes