Gradient boosting machines and careful pre-processing work best: ASHRAE Great Energy Predictor III lessons learned
This provides practical insights for researchers and practitioners in building energy prediction, but it is incremental as it summarizes existing competition results without introducing new methods.
The paper analyzed top solutions from the ASHRAE Great Energy Predictor III competition, finding that ensembles of Gradient Boosting Machine models, particularly using LightGBM, and careful preprocessing were key to success, with the competition involving 39,402 submissions and a $25,000 prize pool.
The ASHRAE Great Energy Predictor III (GEPIII) competition was held in late 2019 as one of the largest machine learning competitions ever held focused on building performance. It was hosted on the Kaggle platform and resulted in 39,402 prediction submissions, with the top five teams splitting $25,000 in prize money. This paper outlines lessons learned from participants, mainly from teams who scored in the top 5% of the competition. Various insights were gained from their experience through an online survey, analysis of publicly shared submissions and notebooks, and the documentation of the winning teams. The top-performing solutions mostly used ensembles of Gradient Boosting Machine (GBM) tree-based models, with the LightGBM package being the most popular. The survey participants indicated that the preprocessing and feature extraction phases were the most important aspects of creating the best modeling approach. All the survey respondents used Python as their primary modeling tool, and it was common to use Jupyter-style Notebooks as development environments. These conclusions are essential to help steer the research and practical implementation of building energy meter prediction in the future.