An Automatic Relevance Determination Prior Bayesian Neural Network for Controlled Variable Selection
This work addresses variable selection challenges in fields like environmental science, offering incremental improvements over existing methods.
The authors tackled the problem of variable selection in high-dimensional data by proposing a Bayesian Neural Network with Automatic Relevance Determination prior as a feature importance statistic for the model-x knockoff filter, resulting in statistically significant improvements in variable selection power and predictive performance on simulated and real-world datasets.
We present an Automatic Relevance Determination prior Bayesian Neural Network(BNN-ARD) weight l2-norm measure as a feature importance statistic for the model-x knockoff filter. We show on both simulated data and the Norwegian wind farm dataset that the proposed feature importance statistic yields statistically significant improvements relative to similar feature importance measures in both variable selection power and predictive performance on a real world dataset.