Differentiable Uncalibrated Imaging
This addresses calibration issues in imaging for applications like computed tomography, though it is incremental as it builds on existing differentiable and neural field methods.
The paper tackles the problem of uncertainty in measurement coordinates like sensor locations and projection angles in imaging by proposing a differentiable framework that jointly fits a measurement representation, optimizes over uncertain coordinates, and performs image reconstruction, resulting in improved reconstructions compared to baselines in 2D and 3D computed tomography.
We propose a differentiable imaging framework to address uncertainty in measurement coordinates such as sensor locations and projection angles. We formulate the problem as measurement interpolation at unknown nodes supervised through the forward operator. To solve it we apply implicit neural networks, also known as neural fields, which are naturally differentiable with respect to the input coordinates. We also develop differentiable spline interpolators which perform as well as neural networks, require less time to optimize and have well-understood properties. Differentiability is key as it allows us to jointly fit a measurement representation, optimize over the uncertain measurement coordinates, and perform image reconstruction which in turn ensures consistent calibration. We apply our approach to 2D and 3D computed tomography, and show that it produces improved reconstructions compared to baselines that do not account for the lack of calibration. The flexibility of the proposed framework makes it easy to extend to almost arbitrary imaging problems.