EASSE-DE: Easier Automatic Sentence Simplification Evaluation for German
This work addresses the problem of evaluating text simplification models in non-English languages, such as German, by providing a framework to improve comparability and transparency, though it is incremental as it builds on an existing English-focused tool.
The authors tackled the lack of multilingual tools for automatic sentence simplification evaluation by extending the EASSE framework to support multiple languages, specifically demonstrating it for German (EASSE-DE) and providing recommendations for more transparent and comparable evaluations.
In this work, we propose EASSE-multi, a framework for easier automatic sentence evaluation for languages other than English. Compared to the original EASSE framework, EASSE-multi does not focus only on English. It contains tokenizers and versions of text simplification evaluation metrics which are suitable for multiple languages. In this paper, we exemplify the usage of EASSE-multi for German TS, resulting in EASSE-DE. Further, we compare text simplification results when evaluating with different language or tokenization settings of the metrics. Based on this, we formulate recommendations on how to make the evaluation of (German) TS models more transparent and better comparable. The code of EASSE-multi and its German specialisation (EASSE-DE) can be found at https://github.com/rstodden/easse-de.