StoryDrawer: A Child-AI Collaborative Drawing System to Support Children's Creative Visual Storytelling

Title of the Paper

StoryDrawer: A Child–AI Collaborative Drawing System to Support Children’s Creative Visual Storytelling

Bibliographic Information

• Subject Area: Child–AI collaborative drawing systems, supporting children’s creative visual storytelling
• Keywords: visual storytelling, drawing, collaborative creation systems, child–AI collaboration, creativity support tools, children

Research Background and Issues

Research Background

• Creative expression has been shown to enhance cognitive skills, support literacy development, and foster creativity.
• "Visual storytelling" is a novel form of creative expression that combines oral storytelling with visual narratives. However, as children grow older (e.g., by fourth grade), creativity tends to decline, a phenomenon referred to as the "fourth-grade slump."

Issues and Challenges

• Key challenges children face in visual storytelling include:
  1. The parallel tasks of storytelling and drawing increase multitasking burdens.
  2. Children often experience "writer's block" or "creative bottlenecks," hindering their ability to continue creating.
  3. Children may lose focus and engagement, negatively affecting the creative process.

Research Motivation

• Based on an analysis of the needs of children and parents, the study aims to design a tool that reduces multitasking burdens, helps overcome creative blocks, and enhances engagement, thereby providing creativity support for children in visual storytelling.

Solution

Method and Design

• A collaborative creation system named StoryDrawer is proposed:
  • The system is AI-driven and integrates a context-based voice agent with two collaboration strategies.
  • The collaboration strategies include:
    1. Real-time Transformation Strategy: Converts children’s verbal content into drawings in real time.
    2. Abstract Sketch Generation Strategy: Generates abstract sketches semantically related to the existing story content to stimulate creativity.

System Architecture and Interaction

• Tool Overview:
  • The system is implemented as a tablet application (iPad) supporting touch and voice interaction.
  • Users can interact with the voice agent using a "Speak Button" or receive creative inspiration through an "Idea Button" that provides abstract sketches.
• Details of the Two Collaboration Strategies:
  • Strategy 1: Real-time Transformation: Extracts key entities (e.g., objects, colors, quantities) from children’s narratives and generates corresponding sketches.
  • Strategy 2: Abstract Sketches: Produces abstract drawings related to the story, guiding users to associate and complete their creations.

Innovations

• Combines embodied cognition theory and visual thinking to support children’s creativity from a cognitive perspective.
• Introduces abstract sketch inspiration using semantic similarity algorithms.
• Enhances interactivity and engagement through a voice agent, beyond merely assisting with drawing.

Research Outcomes

Experimental Results

• Experimental Design:
  • Conducted a 2×2 controlled experiment with 64 children aged 6-10, varying the combinations of the two collaboration strategies (four conditions).
  • Evaluation metrics included creativity fluency, elaboration, drawing creativity, expert ratings, and engagement.
• Results Analysis:
  • Strategy 1 (Real-time Transformation):
    • Significantly improved story elaboration and drawing creativity (but did not significantly enhance creativity fluency).
  • Strategy 2 (Abstract Sketches):
    • Significantly enhanced creativity fluency, elaboration, and drawing creativity.
  • Collaborative Effects:
    • Strategy 1 amplified the effects of Strategy 2.
  • Although the voice agent did not significantly improve engagement metrics, it provided a positive user experience and moderate engagement overall.

Qualitative Analysis

• Impact of Strategies:
  1. Strategy 1 helped children draw detailed characters and environments, advancing story development.
  2. Strategy 2 stimulated associative abilities and creative thinking, addressing "creative bottlenecks."
• User Experience:
  • Most children displayed positive emotional connections with the AI agent, perceiving it as a collaborative partner.
  • Positive relationships fostered further exploration and creative expression.

Advantages and Limitations

• Advantages:
  • Reduced multitasking burdens of storytelling and drawing.
  • Stimulated creativity, resulting in more detailed and imaginative stories.
• Limitations:
  • Does not yet support scene/background generation.
  • AI recognition accuracy and user experience require further optimization.
  • Lacks long-term observation of the system’s impact on children’s creativity development.

Conclusion and Future Directions

Conclusion

• StoryDrawer, through its exploration of AI–child collaborative creation, significantly supports children’s creative expression in visual storytelling.
• Experimental validation demonstrates that the system effectively enhances creativity fluency, elaboration, and drawing creativity, while improving overall user experience.

Future Plans

1. Technical Improvements: Enhance AI’s ability to generate scenes and improve sketch recognition accuracy.
2. Multisensory Support: Incorporate creative stimuli beyond visuals, such as sound.
3. Long-term Studies: Investigate the long-term impact of the system on children’s creativity development.
4. Multi-user Collaboration: Study the effects of social interaction when multiple children collaborate with AI to create visual stories.