Learned harmonic mean estimation of the marginal likelihood for multimodal posteriors with flow matching
This work addresses a specific bottleneck in Bayesian statistics for researchers dealing with complex models, offering an incremental improvement over existing methods.
The authors tackled the challenge of estimating the marginal likelihood for Bayesian model comparison with multimodal posteriors by introducing flow matching-based continuous normalizing flows as an internal density estimator for the learned harmonic mean method, demonstrating its ability to handle a 20-dimensional multimodal example without fine-tuning.
The marginal likelihood, or Bayesian evidence, is a crucial quantity for Bayesian model comparison but its computation can be challenging for complex models, even in parameters space of moderate dimension. The learned harmonic mean estimator has been shown to provide accurate and robust estimates of the marginal likelihood simply using posterior samples. It is agnostic to the sampling strategy, meaning that the samples can be obtained using any method. This enables marginal likelihood calculation and model comparison with whatever sampling is most suitable for the task. However, the internal density estimators considered previously for the learned harmonic mean can struggle with highly multimodal posteriors. In this work we introduce flow matching-based continuous normalizing flows as a powerful architecture for the internal density estimation of the learned harmonic mean. We demonstrate the ability to handle challenging multimodal posteriors, including an example in 20 parameter dimensions, showcasing the method's ability to handle complex posteriors without the need for fine-tuning or heuristic modifications to the base distribution.