Direct Amortized Likelihood Ratio Estimation
This provides improved likelihood ratio estimation for simulation-based inference problems, with applications including quadcopter design.
The authors introduced a direct neural ratio estimator (DNRE) for simulation-based inference that directly computes likelihood ratios between parameter sets, showing it often outperforms previous ratio estimators and demonstrating competitive performance of likelihood-free Hamiltonian Monte Carlo compared to random-walk Metropolis-Hastings.
We introduce a new amortized likelihood ratio estimator for likelihood-free simulation-based inference (SBI). Our estimator is simple to train and estimates the likelihood ratio using a single forward pass of the neural estimator. Our approach directly computes the likelihood ratio between two competing parameter sets which is different from the previous approach of comparing two neural network output values. We refer to our model as the direct neural ratio estimator (DNRE). As part of introducing the DNRE, we derive a corresponding Monte Carlo estimate of the posterior. We benchmark our new ratio estimator and compare to previous ratio estimators in the literature. We show that our new ratio estimator often outperforms these previous approaches. As a further contribution, we introduce a new derivative estimator for likelihood ratio estimators that enables us to compare likelihood-free Hamiltonian Monte Carlo (HMC) with random-walk Metropolis-Hastings (MH). We show that HMC is equally competitive, which has not been previously shown. Finally, we include a novel real-world application of SBI by using our neural ratio estimator to design a quadcopter. Code is available at https://github.com/SRI-CSL/dnre.