NeuroSync: Intent-Aware Code-Based Problem Solving via Direct LLM Understanding Modification
Honorable MentionAuthors
Conversational LLMs have been widely adopted by domain users with limited programming experience to solve domain problems. However, these users often face misalignment between their intent and generated code, resulting in frustration and rounds of clarification. This work first investigates the cause of this misalignment, which dues to bidirectional ambiguity: both user intents and coding tasks are inherently nonlinear, yet must be expressed and interpreted through linear prompts and code sequences. To address this, we propose direct intent–task matching, a new human–LLM interaction paradigm that externalizes and enables direct manipulation of the LLM understanding, i.e., the coding tasks and their relationships inferred by the LLM prior to code generation. As a proof-of-concept, this paradigm is then implemented in NeuroSync, which employs a knowledge distillation pipeline to extract LLM understanding, user intents, and their mappings, and enhances the alignment by allowing users to intuitively inspect and edit them via visualizations. We evaluate the algorithmic components of NeuroSync via technical experiments, and assess its overall usability and effectiveness via a user study (N=12). The results show that it enhances intent–task alignment, lowers cognitive effort, and improves coding efficiency.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
Validating AI-Generated Code with Live Programming
CHI '24· Human-LLM Collaboration +1
- 100%
Exploring the Design Space of Real-time LLM Knowledge Support Systems: A Case Study of Jargon Explanations
CHI '25· Human-LLM Collaboration +1
- 100%
Less or More: Towards Glanceable Explanations for LLM Recommendations Using Ultra-Small Devices
IUI '25· Human-LLM Collaboration +1
- 80%
Ivie: Lightweight Anchored Explanations of Just-Generated Code
CHI '24· Generative AI (Text, Image, Music, Video) +2
- 80%
Interactive Debugging and Steering of Multi-Agent AI Systems
CHI '25· Human-LLM Collaboration +2
- 80%
DIY: Helping People Assess the Correctness of Natural Language to SQL Systems
IUI '21· Human-LLM Collaboration +2
- 80%
Investigating Explainability of Generative Models for Code through Scenario-based Design
IUI '22· Generative AI (Text, Image, Music, Video) +2
- 80%
CoPrompter: User-Centric Evaluation of LM Instruction Alignment for Improved Prompt Engineering
IUI '25· Human-LLM Collaboration +2
- 67%
Planning for Natural Language Failures with the AI Playbook
CHI '21· Human-LLM Collaboration +2
- 67%
Adapting User Interfaces with Model-based Reinforcement Learning
CHI '21· Human-LLM Collaboration +2
Based on Jaccard similarity of research subtopics & professions (≥60%)