CLAIDec 15, 2020

Keyword-Guided Neural Conversational Model

arXiv:2012.08383v339 citations
AI Analysis

This work is significant for improving the ability of conversational agents to achieve specific goals, such as in recommendation systems or psychotherapy, by enabling more natural and efficient keyword guidance. It is an incremental improvement on existing methods.

This paper addresses the challenge of guiding open-domain conversational agents to smoothly and quickly reach a target keyword. The authors propose a model that leverages external commonsense knowledge graphs for keyword transition and response retrieval, demonstrating improved performance in next-turn keyword prediction and faster keyword attainment compared to baselines.

We study the problem of imposing conversational goals/keywords on open-domain conversational agents, where the agent is required to lead the conversation to a target keyword smoothly and fast. Solving this problem enables the application of conversational agents in many real-world scenarios, e.g., recommendation and psychotherapy. The dominant paradigm for tackling this problem is to 1) train a next-turn keyword classifier, and 2) train a keyword-augmented response retrieval model. However, existing approaches in this paradigm have two limitations: 1) the training and evaluation datasets for next-turn keyword classification are directly extracted from conversations without human annotations, thus, they are noisy and have low correlation with human judgements, and 2) during keyword transition, the agents solely rely on the similarities between word embeddings to move closer to the target keyword, which may not reflect how humans converse. In this paper, we assume that human conversations are grounded on commonsense and propose a keyword-guided neural conversational model that can leverage external commonsense knowledge graphs (CKG) for both keyword transition and response retrieval. Automatic evaluations suggest that commonsense improves the performance of both next-turn keyword prediction and keyword-augmented response retrieval. In addition, both self-play and human evaluations show that our model produces responses with smoother keyword transition and reaches the target keyword faster than competitive baselines.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes