AlgOS: Algorithm Operating System
This work addresses the need for standardized and reproducible algorithmic implementations in research, though it is incremental as it builds on existing tools like Optuna and design patterns.
The authors tackled the problem of overhead in implementing and comparing algorithms by introducing AlgOS, an extensible framework that standardizes algorithmic implementations and integrates features like automated hyperparameter tuning and logging, resulting in improved reproducibility and reliability in research.
Algorithm Operating System (AlgOS) is an unopinionated, extensible, modular framework for algorithmic implementations. AlgOS offers numerous features: integration with Optuna for automated hyperparameter tuning; automated argument parsing for generic command-line interfaces; automated registration of new classes; and a centralised database for logging experiments and studies. These features are designed to reduce the overhead of implementing new algorithms and to standardise the comparison of algorithms. The standardisation of algorithmic implementations is crucial for reproducibility and reliability in research. AlgOS combines Abstract Syntax Trees with a novel implementation of the Observer pattern to control the logical flow of algorithmic segments.