ALIGNMEET: A Comprehensive Tool for Meeting Annotation, Alignment, and Evaluation
This tool addresses the problem of efficient and accurate meeting summary annotation and evaluation for researchers in dialogue summarization, though it is incremental as it builds on existing annotation needs without introducing new methods.
The authors tackled the challenge of manually creating, correcting, and evaluating summaries for multi-party meeting dialogues by developing ALIGNMEET, a comprehensive tool for meeting annotation, alignment, and evaluation, which they released as open-source and installable from PyPI.
Summarization is a challenging problem, and even more challenging is to manually create, correct, and evaluate the summaries. The severity of the problem grows when the inputs are multi-party dialogues in a meeting setup. To facilitate the research in this area, we present ALIGNMEET, a comprehensive tool for meeting annotation, alignment, and evaluation. The tool aims to provide an efficient and clear interface for fast annotation while mitigating the risk of introducing errors. Moreover, we add an evaluation mode that enables a comprehensive quality evaluation of meeting minutes. To the best of our knowledge, there is no such tool available. We release the tool as open source. It is also directly installable from PyPI.