Ruangrawee Kitichotkul

Haoyu Zhang, Yanting Ma, Ruangrawee Kitichotkul et al.

This paper introduces an interacting-particle optimization method tailored to possibly non-convex composite optimization problems, which arise widely in signal processing. The proposed method, \emph{ProxiCBO}, integrates consensus-based optimization (CBO) with proximal gradient techniques to handle challenging optimization landscapes and exploit the composite structure of the objective function. We establish global convergence guarantees for the continuous-time finite-particle dynamics and develop an alternating update scheme for efficient practical implementation. Simulation results for signal processing tasks, including signal recovery from one-bit quantized measurements and parameter estimation from single-photon lidar data, demonstrate that ProxiCBO outperforms existing proximal gradient methods and CBO methods in terms of both accuracy and particle-efficiency.

Alexander Mehta, Ruangrawee Kitichotkul, Vivek K Goyal et al.

Equivariant imaging (EI) enables training signal reconstruction models without requiring ground truth data by leveraging signal symmetries. Deep equilibrium models (DEQs) are a powerful class of neural networks where the output is a fixed point of a learned operator. However, training DEQs with complex EI losses requires implicit differentiation through fixed-point computations, whose implementation can be challenging. We show that backpropagation can be implemented modularly, simplifying training. Experiments demonstrate that DEQs trained with implicit differentiation outperform those trained with Jacobian-free backpropagation and other baseline methods. Additionally, we find evidence that EI-trained DEQs approximate the proximal map of an invariant prior.

Ruangrawee Kitichotkul, Christopher A. Metzler, Frank Ong et al.

Convolutional neural networks (CNN) have emerged as a powerful tool for solving computational imaging reconstruction problems. However, CNNs are generally difficult-to-understand black-boxes. Accordingly, it is challenging to know when they will work and, more importantly, when they will fail. This limitation is a major barrier to their use in safety-critical applications like medical imaging: Is that blob in the reconstruction an artifact or a tumor? In this work we use Stein's unbiased risk estimate (SURE) to develop per-pixel confidence intervals, in the form of heatmaps, for compressive sensing reconstruction using the approximate message passing (AMP) framework with CNN-based denoisers. These heatmaps tell end-users how much to trust an image formed by a CNN, which could greatly improve the utility of CNNs in various computational imaging applications.