HyperNOs: Automated and Parallel Library for Neural Operators Research
This work provides a tool for researchers in machine learning to streamline neural operator research, though it is incremental as it builds on existing libraries and methods.
The authors tackled the challenge of automating hyperparameter optimization for neural operators by introducing HyperNOs, a PyTorch library that leverages Ray-tune for parallel computing and achieves state-of-the-art results on multiple benchmarks.
This paper introduces HyperNOs, a PyTorch library designed to streamline and automate the process of exploring neural operators, with a special focus on hyperparameter optimization for comprehensive and exhaustive exploration. Indeed, HyperNOs takes advantage of state-of-the-art optimization algorithms and parallel computing implemented in the Ray-tune library to efficiently explore the hyperparameter space of neural operators. We also implement many useful functionalities for studying neural operators with a user-friendly interface, such as the possibility to train the model with a fixed number of parameters or to train the model with multiple datasets and different resolutions. We integrate Fourier neural operators and convolutional neural operators in our library, achieving state of the art results on many representative benchmarks, demonstrating the capabilities of HyperNOs to handle real datasets and modern architectures. The library is designed to be easy to use with the provided model and datasets, but also to be easily extended to use new datasets and custom neural operator architectures.