BORT: Back and Denoising Reconstruction for End-to-End Task-Oriented Dialog
This addresses error propagation in task-oriented dialog systems, particularly for low-resource applications, but is incremental as it builds on existing reconstruction techniques.
The paper tackles error propagation in end-to-end task-oriented dialog systems by proposing BORT, which uses back and denoising reconstruction to improve dialog state accuracy and reduce errors, showing effectiveness in experiments on MultiWOZ 2.0 and CamRest676 with advanced capabilities in zero-shot and low-resource scenarios.
A typical end-to-end task-oriented dialog system transfers context into dialog state, and upon which generates a response, which usually faces the problem of error propagation from both previously generated inaccurate dialog states and responses, especially in low-resource scenarios. To alleviate these issues, we propose BORT, a back and denoising reconstruction approach for end-to-end task-oriented dialog system. Squarely, to improve the accuracy of dialog states, back reconstruction is used to reconstruct the original input context from the generated dialog states since inaccurate dialog states cannot recover the corresponding input context. To enhance the denoising capability of the model to reduce the impact of error propagation, denoising reconstruction is used to reconstruct the corrupted dialog state and response. Extensive experiments conducted on MultiWOZ 2.0 and CamRest676 show the effectiveness of BORT. Furthermore, BORT demonstrates its advanced capabilities in the zero-shot domain and low-resource scenarios.