CLSep 20, 2019
Towards Neural Language EvaluatorsHassan Kané, Yusuf Kocyigit, Pelkins Ajanoh et al.
We review three limitations of BLEU and ROUGE -- the most popular metrics used to assess reference summaries against hypothesis summaries, come up with criteria for what a good metric should behave like and propose concrete ways to use recent Transformers-based Language Models to assess reference summaries against hypothesis summaries.