ChemGrapher: Optical Graph Recognition of Chemical Compounds by Deep Learning
This work addresses a domain-specific bottleneck in chemistry and pharmaceutical sciences by improving the accuracy of optical graph recognition for chemical compounds, though it is incremental as it builds on existing deep learning approaches.
The paper tackled the problem of automatically converting images of chemical compounds into graph structures, which is crucial for drug discovery, by developing a deep learning-based method that significantly reduces errors compared to existing tools.
In drug discovery, knowledge of the graph structure of chemical compounds is essential. Many thousands of scientific articles in chemistry and pharmaceutical sciences have investigated chemical compounds, but in cases the details of the structure of these chemical compounds is published only as an images. A tool to analyze these images automatically and convert them into a chemical graph structure would be useful for many applications, such drug discovery. A few such tools are available and they are mostly derived from optical character recognition. However, our evaluation of the performance of those tools reveals that they make often mistakes in detecting the correct bond multiplicity and stereochemical information. In addition, errors sometimes even lead to missing atoms in the resulting graph. In our work, we address these issues by developing a compound recognition method based on machine learning. More specifically, we develop a deep neural network model for optical compound recognition. The deep learning solution presented here consists of a segmentation model, followed by three classification models that predict atom locations, bonds and charges. Furthermore, this model not only predicts the graph structure of the molecule but also produces all information necessary to relate each component of the resulting graph to the source image. This solution is scalable and could rapidly process thousands of images. Finally, we compare empirically the proposed method to a well-established tool and observe significant error reductions.