Design Ideation with AI - Sketching, Thinking and Talking with Generative Machine Learning Models
Generative machine learning models provide opportunities to support design work in various parts of the design process. This study investigates how generative machine learning and large language models may play a part in creative design processes of ideation, early prototyping and sketching. A workshop was conducted in which design practitioners and design researchers developed design concepts for a provided design case, with the help of GPT-3. The findings point to three main themes, including i) the practical usefulness and limitations of the system in design ideation processes, ii) how the form of user interaction shapes users' expectations of the system's capabilities and potentials, and iii), how the broader discourse around AI both limits and enables how co-creative processes involving human and AI unfolds. The discussion outlines design implications and alternative framings of this kind of co-creative design practices based on post-human perspectives on design and technology use.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools
CHI '23· Generative AI (Text, Image, Music, Video) +1
- 80%
ICONATE: Automatic Compound Icon Generation and Ideation
CHI '20· Generative AI (Text, Image, Music, Video) +2
- 80%
Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models
CHI '24· Generative AI (Text, Image, Music, Video) +2
- 80%
Dancing With Chains: Ideating Under Constraints With UIDEC in UI/UX Design
CHI '25· 360° Video & Panoramic Content +2
- 80%
DesignMinds: Enhancing Video-Based Design Ideation with a Vision-Language Model and a Context-Injected Large Language Model
CUI '25· Generative AI (Text, Image, Music, Video) +2
- 80%
”Clay to Play With”: Generative AI Tools in UX and Industrial Design Practice
DIS '24· Generative AI (Text, Image, Music, Video) +2
- 80%
BO as Assistant: Using Bayesian Optimization for Asynchronously Generating Design Suggestions
UIST '22· Generative AI (Text, Image, Music, Video) +2
- 80%
GenTune: Toward Traceable Prompts to Improve Controllability of Image Refinement in Environment Design
UIST '25· Generative AI (Text, Image, Music, Video) +2
- 75%
User Experience Design Professionals’ Perceptions of Generative Artificial Intelligence
CHI '24· Generative AI (Text, Image, Music, Video) +1
- 75%
Hidden Layer Interaction: A Technique to Explore the Material of Generative AI
DIS '25· Generative AI (Text, Image, Music, Video)
Based on Jaccard similarity of research subtopics & professions (≥60%)