Microsoft Dialogue Challenge: Building End-to-End Task-Completion Dialogue Systems
This addresses the need for standardized datasets and environments in the dialogue research community, though it is incremental as it builds on existing efforts.
The paper tackles the problem of advancing end-to-end task-completion dialogue systems by proposing a challenge to encourage collaboration and benchmarking, resulting in the release of human-annotated conversational data in three domains and an experiment platform for training and evaluation.
This proposal introduces a Dialogue Challenge for building end-to-end task-completion dialogue systems, with the goal of encouraging the dialogue research community to collaborate and benchmark on standard datasets and unified experimental environment. In this special session, we will release human-annotated conversational data in three domains (movie-ticket booking, restaurant reservation, and taxi booking), as well as an experiment platform with built-in simulators in each domain, for training and evaluation purposes. The final submitted systems will be evaluated both in simulated setting and by human judges.