HCAICLSEAug 5, 2025

NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modification

arXiv:2508.02823v19 citationsh-index: 12UIST
Originality Highly original
AI Analysis

This addresses the problem of frustration and inefficiency for domain users with limited programming experience when using conversational LLMs for code-based problem solving, representing a novel paradigm rather than an incremental improvement.

The paper tackles the misalignment between user intent and generated code in conversational LLMs for domain users with limited programming experience by proposing a new interaction paradigm that externalizes and allows direct manipulation of LLM understanding, resulting in enhanced alignment, lower cognitive effort, and improved coding efficiency as shown in a user study with 12 participants.

Conversational LLMs have been widely adopted by domain users with limited programming experience to solve domain problems. However, these users often face misalignment between their intent and generated code, resulting in frustration and rounds of clarification. This work first investigates the cause of this misalignment, which dues to bidirectional ambiguity: both user intents and coding tasks are inherently nonlinear, yet must be expressed and interpreted through linear prompts and code sequences. To address this, we propose direct intent-task matching, a new human-LLM interaction paradigm that externalizes and enables direct manipulation of the LLM understanding, i.e., the coding tasks and their relationships inferred by the LLM prior to code generation. As a proof-of-concept, this paradigm is then implemented in NeuroSync, which employs a knowledge distillation pipeline to extract LLM understanding, user intents, and their mappings, and enhances the alignment by allowing users to intuitively inspect and edit them via visualizations. We evaluate the algorithmic components of NeuroSync via technical experiments, and assess its overall usability and effectiveness via a user study (N=12). The results show that it enhances intent-task alignment, lowers cognitive effort, and improves coding efficiency.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes