CLAIAug 5, 2022

BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage

Meta AIMILA
arXiv:2208.03188v3291 citationsh-index: 107
Originality Incremental advance
AI Analysis

This work advances open-domain dialogue systems for public interaction, though it is incremental with improvements in scale and deployment.

The researchers developed BlenderBot 3, a 175B parameter conversational AI with internet access and memory, which outperformed existing dialogue agents in human evaluations.

We present BlenderBot 3, a 175B parameter dialogue model capable of open-domain conversation with access to the internet and a long-term memory, and having been trained on a large number of user defined tasks. We release both the model weights and code, and have also deployed the model on a public web page to interact with organic users. This technical report describes how the model was built (architecture, model and training scheme), and details of its deployment, including safety mechanisms. Human evaluations show its superiority to existing open-domain dialogue agents, including its predecessors (Roller et al., 2021; Komeili et al., 2022). Finally, we detail our plan for continual learning using the data collected from deployment, which will also be publicly released. The goal of this research program is thus to enable the community to study ever-improving responsible agents that learn through interaction.

Code Implementations5 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes