Sketching NLP: A Case Study of Exploring the Right Things To Design with Language Intelligence
Honorable MentionAuthors
This paper investigates how to sketch NLP-powered user experiences. Sketching is a cornerstone of design innovation. When sketching, designers rapidly experiment with a number of abstract ideas using simple, tangible instruments such as drawings and paper prototypes. Sketching NLP-powered experiences, however, presents challenges, i.e. How to visualize abstract language interaction? How to ideate a broad range of technically feasible intelligent functionalities? As a first step towards understanding these challenges, we present a first-person account of our sketching process when designing intelligent writing assistance. We detail the challenges we encountered and emergent solutions, such as a new format of wireframe for sketching language interactions and a new wizard-of-oz-based NLP rapid prototyping method. Drawing on these findings, we discuss the importance of abstraction in sketching and other implications.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 75%
Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language Models
UIST '23· Human-LLM Collaboration
- 60%
Mapping Machine Learning Advances from HCI Research to Reveal Starting Places for Design Innovation
CHI '18· Human-LLM Collaboration
- 60%
An Evaluation of Situational Autonomy for Human-AI Collaboration in a Shared Workspace Setting
CHI '24· Human-LLM Collaboration +1
- 60%
IntentTuner: An Interactive Framework for Integrating Human Intentions in Fine-tuning Text-to-Image Generative Models
CHI '24· Generative AI (Text, Image, Music, Video) +1
- 60%
Bridging the Gulf of Envisioning: Cognitive Challenges in Prompt Based Interactions with LLMs
CHI '24· Human-LLM Collaboration +1
- 60%
Deus Ex Machina and Personas from Large Language Models: Investigating the Composition of AI-Generated Persona Descriptions
CHI '24· Human-LLM Collaboration +1
- 60%
User Experience of LLM-based Recommendation Systems: A Case of Music Recommendation
CHI '25· Human-LLM Collaboration +1
- 60%
AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Tools
CHI '25· Generative AI (Text, Image, Music, Video) +1
- 60%
IdeationWeb: Tracking the Evolution of Design Ideas in Human-AI Co-Creation
CHI '25· Human-LLM Collaboration +1
- 60%
No Evidence for LLMs Being Useful in Problem Reframing
CHI '25· Human-LLM Collaboration +1
Based on Jaccard similarity of research subtopics & professions (≥60%)