AISep 15, 2025

BuildingGym: An open-source toolbox for AI-based building energy management using reinforcement learning

arXiv:2509.11922v124 citationsh-index: 17Has CodeBuild Simul
Originality Synthesis-oriented
AI Analysis

This provides a practical tool for building managers and AI specialists to optimize energy management, though it is incremental as it builds on existing RL and simulation methods.

The authors tackled the lack of a flexible framework for implementing reinforcement learning (RL) in building energy management by developing BuildingGym, an open-source toolbox that integrates EnergyPlus and provides built-in RL algorithms, which demonstrated strong performance in cooling load management tasks.

Reinforcement learning (RL) has proven effective for AI-based building energy management. However, there is a lack of flexible framework to implement RL across various control problems in building energy management. To address this gap, we propose BuildingGym, an open-source tool designed as a research-friendly and flexible framework for training RL control strategies for common challenges in building energy management. BuildingGym integrates EnergyPlus as its core simulator, making it suitable for both system-level and room-level control. Additionally, BuildingGym is able to accept external signals as control inputs instead of taking the building as a stand-alone entity. This feature makes BuildingGym applicable for more flexible environments, e.g. smart grid and EVs community. The tool provides several built-in RL algorithms for control strategy training, simplifying the process for building managers to obtain optimal control strategies. Users can achieve this by following a few straightforward steps to configure BuildingGym for optimization control for common problems in the building energy management field. Moreover, AI specialists can easily implement and test state-of-the-art control algorithms within the platform. BuildingGym bridges the gap between building managers and AI specialists by allowing for the easy configuration and replacement of RL algorithms, simulators, and control environments or problems. With BuildingGym, we efficiently set up training tasks for cooling load management, targeting both constant and dynamic cooling load management. The built-in algorithms demonstrated strong performance across both tasks, highlighting the effectiveness of BuildingGym in optimizing cooling strategies.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes