Improved stochastic trace estimation using mutually unbiased bases
This work addresses the need for efficient trace estimation in numerical linear algebra, offering lower variance and reduced randomness requirements.
The paper introduces a method for trace estimation using mutually unbiased bases, achieving state-of-the-art single-shot sampling variance while requiring only O(log n) random bits per vector, significantly improving over Hutchinson's and Gaussian estimators.
We examine the problem of estimating the trace of a matrix $A$ when given access to an oracle which computes $x^\dagger A x$ for an input vector $x$. We make use of the basis vectors from a set of mutually unbiased bases, widely studied in the field of quantum information processing, in the selection of probing vectors $x$. This approach offers a new state of the art single shot sampling variance while requiring only $O(\log(n))$ random bits to generate each vector. This significantly improves on traditional methods such as Hutchinson's and Gaussian estimators in terms of the number of random bits required and worst case sample variance.