The Accuracy of Restricted Boltzmann Machine Models of Ising Systems
This work provides insights for physicists using RBMs to model specific physical systems, but it is incremental as it focuses on parameter optimization rather than introducing new methods.
The study investigated how hyperparameters like learning rate, hidden nodes, and threshold functions affect Restricted Boltzmann Machine (RBM) accuracy in modeling Ising spin systems, identifying a tradeoff between statistical quantity accuracy and joint distribution fidelity.
Restricted Boltzmann machine (RBM) provide a general framework for modeling physical systems, but their behavior is dependent on hyperparameters such as the learning rate, the number of hidden nodes and the form of the threshold function. This article accordingly examines in detail the influence of these parameters on Ising spin system calculations. A tradeoff is identified between the accuracy of statistical quantities such as the specific heat and that of the joint distribution of energy and magnetization. The optimal structure of the RBM therefore depends intrinsically on the physical problem to which it is applied.