Hyperparameter optimization, quantum-assisted model performance prediction, and benchmarking of AI-based High Energy Physics workloads using HPC
This addresses resource efficiency in AI model tuning for high-energy physics researchers, but it is incremental as it integrates quantum methods into existing classical pipelines.
This work tackles the compute-intensive nature of hyperparameter optimization for deep learning models by using model performance prediction on HPC systems, achieving results on a quantum annealer comparable to classical machines, and develops a containerized benchmark for assessing hardware accelerators in AI-based high-energy physics workloads.
Training and Hyperparameter Optimization (HPO) of deep learning-based AI models are often compute resource intensive and calls for the use of large-scale distributed resources as well as scalable and resource efficient hyperparameter search algorithms. This work studies the potential of using model performance prediction to aid the HPO process carried out on High Performance Computing systems. In addition, a quantum annealer is used to train the performance predictor and a method is proposed to overcome some of the problems derived from the current limitations in quantum systems as well as to increase the stability of solutions. This allows for achieving results on a quantum machine comparable to those obtained on a classical machine, showing how quantum computers could be integrated within classical machine learning tuning pipelines. Furthermore, results are presented from the development of a containerized benchmark based on an AI-model for collision event reconstruction that allows us to compare and assess the suitability of different hardware accelerators for training deep neural networks.