StoryCoder: Teaching Computational Thinking Concepts Through Storytelling in a Voice-Guided App for Children

Title of the Paper

StoryCoder: Teaching Computational Thinking Concepts Through Storytelling in a Voice-Guided App for Children

Paper Information

• Domain: Computational Thinking Education, Children's Learning Technology and Language Development
• Keywords: Children, Computational Thinking, Storytelling, Voice User Interface

Research Background and Problem

• Problems or Challenges Identified by the Authors:

  1. Existing computational thinking education tools often rely heavily on advanced literacy skills, operational abilities, or expensive hardware, making them unsuitable for younger students.
  2. The infrastructure for teaching computational thinking to children does not adequately cover all students, particularly those from low-income or minority groups.
  3. There is a lack of high-quality tools for teaching computational thinking concepts in early education.

• Why This Problem Is Important:

  1. Early exposure to computational thinking can not only increase interest in computing fields among minority and female students but also cultivate lifelong skills that enhance academic performance.
  2. Storytelling has significant effects on early childhood language and social skill development, promoting listening, reading, and writing abilities.

• Research Motivation and Related Work: By designing a voice-guided educational tool, children can learn computational thinking concepts through creative activities such as storytelling and story modification. This approach reduces literacy barriers while enhancing equitable access to technology.

Solution

• Proposed Solution:

  1. Develop a voice-guided smartphone app, "StoryCoder," which introduces computational thinking concepts through storytelling.
  2. The app achieves learning objectives through two story creation mini-games and four computational thinking games (introducing sequence, loops, events, and variables concepts).

• Innovative Aspects of the Solution:

  1. Utilizes a voice interface to minimize literacy requirements for education while reducing hardware costs.
  2. Integrates computational thinking with the familiar theme of storytelling for children, enhancing the learning experience through games.

• Implementation Steps and Key Technologies:

  1. App Design:
     • Create two story-related activities: building stories and listening to stories.
     • Develop four computational concept games: Scrambled Sequences (sequence), Loopy Music (loops), Word Events (events), and Very Variable (variables).
  2. Testing and Validation:
     • Conduct "Wizard-of-Oz" testing and rapid iterative design to refine the interface and functionality.
     • Perform short-term evaluation tests over four days with 22 children to measure key learning outcomes.
  3. Technical Implementation:
     • Develop the iOS app using Swift and integrate Google Cloud Speech tools for voice recognition and synthesis.

Research Outcomes

• Specific Outcomes:

  1. The app's games effectively help children understand computational thinking concepts and practice them.
  2. Older children were able to produce higher-quality story content using the system.
  3. Experiments showed that children could recognize and transfer computational concepts to new contexts, demonstrating positive learning attitudes.

• Advantages Over Existing Solutions:

  1. Provides a learning environment with no literacy barriers, fully supporting children's personalized creativity.
  2. Reduces barriers to technology and knowledge acquisition through voice navigation and storytelling modes.
  3. Suitable for home education, especially for children who have not been exposed to computing courses.

• Experimental Evaluation Results:

  1. All children successfully used the app to complete tasks based on computational thinking and storytelling.
  2. The average recall score for the four computational concepts was 3.31/6 (maximum score), significantly better than random guessing.
  3. Children perceived the app as significantly more helpful for learning computer-related courses compared to subjects like art or physical education.

• Limitations and Future Directions:

  • Limitations:
    1. The current study only involves short-term evaluations and does not fully test the effects of long-term use on children's knowledge transfer.
    2. Exploration of knowledge transfer in story structures is limited, with no clear progress observed.
  • Future Directions:
    1. Expand multimodal design by introducing visual components into the system to further assist children in understanding abstract concepts.
    2. Conduct long-term longitudinal studies to investigate the effectiveness of such applications in real educational environments and expand the sample size.
    3. Improve interface design, such as optimizing the simplicity of voice commands and clarifying user input prompts.