Designing Co-Creative AI for Virtual Environments
Authors
Co-creative AI tools provide a method of creative collaboration between a user and machine. One form of co-creative AI called generative design requires the user to input design parameters and wait substantial periods of time while the system computes design solutions. We explore this interaction dynamic by providing an embodied experience in VR. Calliope is a virtual reality (VR) system that enables users to explore and manipulate generative design solutions in real time. Calliope accounts for the typical idle times in the generative design process by using a virtual environment to encourage parallelized and embodied data-exploration and synthesis, while maintaining a tight human-in-the-loop collaboration with the underlying algorithms. In this paper we discuss design considerations informed by formative studies with generative designers and artists, and provide design guidelines to aid others in the development of co-creative AI systems in virtual environments.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 80%
Evolving Roles and Workflows of Creative Practitioners in the Age of Generative AI
C&C '24· Generative AI (Text, Image, Music, Video) +1
- 75%
ShadowMagic: Designing Human-AI Collaborative Support for Comic Professionals’ Shadowing
UIST '24· Generative AI (Text, Image, Music, Video) +1
- 67%
Understanding User Perceptions and the Role of AI Image Generators in Image Creation Workflows
CHI '25· Generative AI (Text, Image, Music, Video) +2
- 60%
GANravel: User-Driven Direction Disentanglement in Generative Adversarial Networks
CHI '23· Generative AI (Text, Image, Music, Video) +1
- 60%
Towards a Diffractive Analysis of Prompt-Based Generative AI
CHI '24· Generative AI (Text, Image, Music, Video) +1
- 60%
Creative Reflections on Image-Making with Artificial Intelligence: Interactions with a Provocative ‘Camera’
CHI '25· Generative AI (Text, Image, Music, Video) +1
- 60%
Artinter: AI-powered Boundary Objects for Commissioning Visual Arts
DIS '23· Generative AI (Text, Image, Music, Video) +1
- 60%
We-toon: A Communication Support System between Writers and Artists in Collaborative Webtoon Sketch Revision
UIST '22· Generative AI (Text, Image, Music, Video) +1
Based on Jaccard similarity of research subtopics & professions (≥60%)