FlexMS is a flexible framework for benchmarking deep learning-based mass spectrum prediction tools in metabolomics
This work addresses the challenge of assessing deep learning models for mass spectrum prediction in metabolomics, which is crucial for drug discovery and material science, by providing a standardized benchmarking framework.
The authors developed FlexMS, a flexible framework for benchmarking deep learning models that predict mass spectra from molecular structures. FlexMS allows for the construction and evaluation of various model architectures on public datasets, providing insights into factors influencing performance such as dataset diversity, hyperparameters, and pretraining effects.
The identification and property prediction of chemical molecules is of central importance in the advancement of drug discovery and material science, where the tandem mass spectrometry technology gives valuable fragmentation cues in the form of mass-to-charge ratio peaks. However, the lack of experimental spectra hinders the attachment of each molecular identification, and thus urges the establishment of prediction approaches for computational models. Deep learning models appear promising for predicting molecular structure spectra, but overall assessment remains challenging as a result of the heterogeneity in methods and the lack of well-defined benchmarks. To address this, our contribution is the creation of benchmark framework FlexMS for constructing and evaluating diverse model architectures in mass spectrum prediction. With its easy-to-use flexibility, FlexMS supports the dynamic construction of numerous distinct combinations of model architectures, while assessing their performance on preprocessed public datasets using different metrics. In this paper, we provide insights into factors influencing performance, including the structural diversity of datasets, hyperparameters like learning rate and data sparsity, pretraining effects, metadata ablation settings and cross-domain transfer learning analysis. This provides practical guidance in choosing suitable models. Moreover, retrieval benchmarks simulate practical identification scenarios and score potential matches based on predicted spectra.