Dynamic Epistemic Friction in Dialogue
This addresses the challenge of improving belief alignment in dialogue systems for human-AI collaboration, though it appears incremental as it builds on existing epistemic logic frameworks.
The paper tackles the problem of belief updating in human-AI dialogue by defining dynamic epistemic friction as resistance to integrating new information, and demonstrates that this model can effectively predict belief updates in collaborative tasks.
Recent developments in aligning Large Language Models (LLMs) with human preferences have significantly enhanced their utility in human-AI collaborative scenarios. However, such approaches often neglect the critical role of "epistemic friction," or the inherent resistance encountered when updating beliefs in response to new, conflicting, or ambiguous information. In this paper, we define dynamic epistemic friction as the resistance to epistemic integration, characterized by the misalignment between an agent's current belief state and new propositions supported by external evidence. We position this within the framework of Dynamic Epistemic Logic (Van Benthem and Pacuit, 2011), where friction emerges as nontrivial belief-revision during the interaction. We then present analyses from a situated collaborative task that demonstrate how this model of epistemic friction can effectively predict belief updates in dialogues, and we subsequently discuss how the model of belief alignment as a measure of epistemic resistance or friction can naturally be made more sophisticated to accommodate the complexities of real-world dialogue scenarios.