Report from the NSF Future Directions Workshop on Automatic Evaluation of Dialog: Research Directions and Challenges
Shikib Mehri, Jinho Choi, Luis Fernando D'Haro, Jan Deriu, Maxine Eskenazi, Milica Gasic, Kallirroi Georgila, Dilek Hakkani-Tur, Zekang Li, Verena Rieser, Samira Shaikh, David Traum
arXiv:2203.10012v123 citationsh-index: 61
Originality Synthesis-oriented
AI Analysis
It identifies challenges and opportunities for researchers in dialog systems, but is incremental as it consolidates existing knowledge rather than presenting new findings.
This report summarizes a workshop on automatic evaluation of dialog, addressing the problem of assessing dialog systems by reviewing current methods and their limitations, and proposing future research directions.
This is a report on the NSF Future Directions Workshop on Automatic Evaluation of Dialog. The workshop explored the current state of the art along with its limitations and suggested promising directions for future work in this important and very rapidly changing area of research.