CHARTER: heatmap-based multi-type chart data extraction
This addresses the under-explored challenge of digitizing chart graphics in documents for easier storage and analysis, representing a domain-specific incremental improvement.
The paper tackles the problem of converting document charts into machine-readable tabular data by proposing a heatmap-based method that detects graphical elements like pie charts and line plots more precisely than bounding-box approaches, achieving high robustness and precision on benchmarks.
The digital conversion of information stored in documents is a great source of knowledge. In contrast to the documents text, the conversion of the embedded documents graphics, such as charts and plots, has been much less explored. We present a method and a system for end-to-end conversion of document charts into machine readable tabular data format, which can be easily stored and analyzed in the digital domain. Our approach extracts and analyses charts along with their graphical elements and supporting structures such as legends, axes, titles, and captions. Our detection system is based on neural networks, trained solely on synthetic data, eliminating the limiting factor of data collection. As opposed to previous methods, which detect graphical elements using bounding-boxes, our networks feature auxiliary domain specific heatmaps prediction enabling the precise detection of pie charts, line and scatter plots which do not fit the rectangular bounding-box presumption. Qualitative and quantitative results show high robustness and precision, improving upon previous works on popular benchmarks