From Dashboards to Dialogue: Evaluating a Conversational AI Coach for Performance Driving Skill Development
Authors
Learning in domains involving complex motor skills, such as performance driving, often requires feedback that is timely, personalized, and actionable. Yet many drivers rely on video and telemetry data to review their performance without guidance. We explore how conversational AI can support post-drive reflection by integrating LLM-generated coaching into an interactive review interface. In an exploratory within-subjects simulator study (n=16), participants completed laps under two conditions: one with video and data visualizations alone, and another with the same tools augmented with a conversational interface that provided verbal feedback after each lap. Conversational feedback supported short-term improvements in lap time, average speed, and steering control, and was rated as more useful and satisfying—though it also elicited slightly higher nervousness. These results suggest that conversational AI can make post-drive feedback more interpretable and actionable, particularly for drivers reviewing performance data in high-skill contexts like performance driving.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 60%
Effects of Communication Directionality and AI Agent Differences in Human-AI Interaction
CHI '21· Human-LLM Collaboration +1
- 60%
AI Knowledge: Improving AI Delegation through Human Enablement
CHI '23· Human-LLM Collaboration +1
- 60%
Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communication
CHI '23· Human-LLM Collaboration +1
- 60%
How Do Data Analysts Respond to AI Assistance? A Wizard-of-Oz Study
CHI '24· Human-LLM Collaboration +1
- 60%
VAL: Interactive Task Learning with GPT Dialog Parsing
CHI '24· Human-LLM Collaboration +1
- 60%
Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making
CHI '25· Human-LLM Collaboration +1
- 60%
Need Help? Designing Proactive AI Assistants for Programming
CHI '25· Human-LLM Collaboration +1
- 60%
A Survey on Interactive Reinforcement Learning: Design Principles and Open Challenges
DIS '20· Human-LLM Collaboration +1
- 60%
Preference-Conditioned Language-Guided Abstraction
HRI '24· Human-LLM Collaboration +2
- 60%
Decision rule elicitation for domain adaptation
IUI '21· Human-LLM Collaboration +1
Based on Jaccard similarity of research subtopics & professions (≥60%)