MathWriting: A Dataset For Handwritten Mathematical Expression Recognition
This dataset facilitates the sharing, searching, and preservation of scientific information by enabling handwritten mathematical expression recognition.
The authors introduced MathWriting, the largest online handwritten mathematical expression dataset with 230k human-written and 400k synthetic samples, and provided baseline performance results for standard models like OCR and CTC Transformer as well as Vision-Language Models like PaLI.
Recognition of handwritten mathematical expressions allows to transfer scientific notes into their digital form. It facilitates the sharing, searching, and preservation of scientific information. We introduce MathWriting, the largest online handwritten mathematical expression dataset to date. It consists of 230k human-written samples and an additional 400k synthetic ones}. This dataset can also be used in its rendered form for offline HME recognition. One MathWriting sample consists of a formula written on a touch screen and a corresponding LaTeX expression. We also provide a normalized version of LaTeX expression to simplify the recognition task and enhance the result quality. We provide baseline performance of standard models like OCR and CTC Transformer as well as Vision-Language Models like PaLI on the dataset. The dataset together with an example colab is accessible on Github.