HCAIJun 24, 2025

Beyond Autocomplete: Designing CopilotLens Towards Transparent and Explainable AI Coding Agents

U of Toronto
arXiv:2506.20062v31 citationsh-index: 3
Originality Synthesis-oriented
AI Analysis

This addresses the problem of inscrutable AI decision-making for developers, but it is incremental as it builds on existing code assistant tools.

The paper tackles the opacity of AI code assistants by introducing CopilotLens, a framework that provides transparent explanations for code suggestions, aiming to improve developer comprehension and trust, though results are not yet evaluated.

AI-powered code assistants are widely used to generate code completions, significantly boosting developer productivity. However, these tools typically present suggestions without explaining their rationale, leaving their decision-making process inscrutable. This opacity hinders developers' ability to critically evaluate outputs, form accurate mental models, and calibrate trust in the system. To address this, we introduce CopilotLens, a novel interactive framework that reframes code completion from a simple suggestion into a transparent, explainable interaction. CopilotLens operates as an explanation layer that reconstructs the AI agent's "thought process" through a dynamic, two-level interface. The tool aims to surface both high-level code changes and the specific codebase context influences. This paper presents the design and rationale of CopilotLens, offering a concrete framework and articulating expectations on deepening comprehension and calibrated trust, which we plan to evaluate in subsequent work.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes