GP-BART: a novel Bayesian additive regression trees approach using Gaussian processes
This is an incremental improvement for researchers and practitioners in regression modeling, addressing specific cases where standard BART underperforms.
The authors tackled the limitations of Bayesian additive regression trees (BART) in handling smoothness and covariance structures by proposing GP-BART, which integrates Gaussian process priors into terminal nodes, resulting in improved performance over traditional methods in simulated and real-world data.
The Bayesian additive regression trees (BART) model is an ensemble method extensively and successfully used in regression tasks due to its consistently strong predictive performance and its ability to quantify uncertainty. BART combines "weak" tree models through a set of shrinkage priors, whereby each tree explains a small portion of the variability in the data. However, the lack of smoothness and the absence of an explicit covariance structure over the observations in standard BART can yield poor performance in cases where such assumptions would be necessary. The Gaussian processes Bayesian additive regression trees (GP-BART) model is an extension of BART which addresses this limitation by assuming Gaussian process (GP) priors for the predictions of each terminal node among all trees. The model's effectiveness is demonstrated through applications to simulated and real-world data, surpassing the performance of traditional modeling approaches in various scenarios.