Summary Workbench: Unifying Application and Evaluation of Text Summarization Models
This tool addresses the need for a unified platform for researchers and practitioners in text summarization to streamline model development and evaluation, though it is incremental as it builds on existing plugin and visualization concepts.
The paper tackles the challenge of developing and evaluating text summarization models by introducing Summary Workbench, a tool that allows easy integration of new models and evaluation measures as Docker-based plugins, enabling comprehensive analysis of model performance through visual insights.
This paper presents Summary Workbench, a new tool for developing and evaluating text summarization models. New models and evaluation measures can be easily integrated as Docker-based plugins, allowing to examine the quality of their summaries against any input and to evaluate them using various evaluation measures. Visual analyses combining multiple measures provide insights into the models' strengths and weaknesses. The tool is hosted at \url{https://tldr.demo.webis.de} and also supports local deployment for private resources.