DeepRV: Accelerating spatiotemporal inference with pre-trained neural priors
This addresses the scalability bottleneck for practitioners using GPs in spatiotemporal modeling, offering a drop-in replacement that preserves flexibility.
The paper tackles the computational intractability of Gaussian Processes (GPs) for large spatiotemporal datasets by introducing DeepRV, a neural-network surrogate that matches full GP accuracy while reducing complexity to O(N^2), achieving the highest fidelity to exact GPs and accelerating inference in benchmarks and a real-world application with 4,994 locations.
Gaussian Processes (GPs) provide a flexible and statistically principled foundation for modelling spatiotemporal phenomena, but their $O(N^3)$ scaling makes them intractable for large datasets. Approximate methods such as variational inference (VI), inducing points (sparse GPs), low-rank factorizations (RFFs), local factorizations and approximations (INLA), improve scalability but trade off accuracy or flexibility. We introduce DeepRV, a neural-network surrogate that closely matches full GP accuracy including hyperparameter estimates, while reducing computational complexity to $O(N^2)$, increasing scalability and inference speed. DeepRV serves as a drop-in replacement for GP prior realisations in e.g. MCMC-based probabilistic programming pipelines, preserving full model flexibility. Across simulated benchmarks, non-separable spatiotemporal GPs, and a real-world application to education deprivation in London (n = 4,994 locations), DeepRV achieves the highest fidelity to exact GPs while substantially accelerating inference. Code is provided in the accompanying ZIP archive, with all experiments run on a single consumer-grade GPU to ensure accessibility for practitioners.