Statistically and Computationally Efficient Variance Estimator for Kernel Ridge Regression
This work addresses the need for efficient variance estimation in kernel ridge regression, which is important for statistical inference in machine learning, but it appears incremental as it builds on existing methods with computational improvements.
The paper tackles the problem of estimating variance in kernel ridge regression by proposing a random projection approach, which results in a consistent estimator that is computationally more efficient and optimal for a wide range of kernels, including cubic splines and Gaussian kernels, as supported by simulation analysis.
In this paper, we propose a random projection approach to estimate variance in kernel ridge regression. Our approach leads to a consistent estimator of the true variance, while being computationally more efficient. Our variance estimator is optimal for a large family of kernels, including cubic splines and Gaussian kernels. Simulation analysis is conducted to support our theory.