Xylocode: A Novel Approach to Fostering Interest in Computer Science via an Embodied Music Simulation

Title of the Paper

Xylocode: A Novel Approach to Fostering Interest in Computer Science via an Embodied Music Simulation

Paper Information

• Subject Areas: Human-Computer Interaction, Computer Science Education, Museum Design, Music Technology
• Keywords: CS Education, Informal Learning, Tangible User Interface, Music and Computing, Interest Development, Museum Exhibits

Research Background and Problem

• What problems or challenges did the authors identify?
  Fostering learners' interest in computer science (CS) education remains a significant challenge. Practitioners often perceive programming as dull, uncreative, or irrelevant to personal interests. Many existing approaches to computing education focus on formal learning environments, such as classrooms or after-school activities, with limited exploration of how to design experiences in informal learning spaces to promote interest.

• Why is this problem important?
  Sparking interest is considered a key factor in cultivating long-term learning and career development in computer science. This is especially critical for middle school students, as this age group begins to make decisions about future career paths and establish connections with specific fields of study.

• Research Motivation and Related Work
  Previous research by the authors has successfully combined music and programming to foster interest, such as through creating music via programming (e.g., EarSketch). Additionally, efforts to design museum exhibits using tangible user interfaces and creative interactions have shown potential for sparking interest. However, existing studies often face challenges such as complex interfaces, high learning thresholds for syntax, and low hardware stability. These challenges inspired the authors to explore a more accessible and intuitive approach, enabling learners to create complex and engaging musical patterns through simple rules.

Solution

• What methods or solutions did the authors propose?
  The authors proposed a museum exhibit design called Xylocode, which leverages computational music remixing, tangible user interfaces, and an embodied simulation environment to spark middle school students' interest in computer science. The exhibit eliminates the need for programming syntax, allowing learners to create complex musical patterns by modifying simple rules.

• What is innovative about this solution?
  The innovation of Xylocode lies in its intuitive embodied design, which integrates tangible characters (e.g., frogs) with interactive scenarios. By employing easily understandable rules and feedback mechanisms for music creation, it reduces technical barriers and encourages collaboration and physical intuition. Unlike traditional block-based programming learning methods, it does not require prior knowledge of programming syntax, thereby lowering the entry threshold.

• What are the implementation steps and key technologies used?

  • Design Iterations: Xylocode underwent several design iterations, including prototypes based on cellular automata, tangible tabletop displays, and a browser-based version.
  • Final Design: The final design integrates frog characters, arrays of flowers, global variables (e.g., sound types), and conditional logic, supporting multi-user interaction and collaboration.
  • Technology Stack: Unity and Ideum tabletop multi-touch interfaces were used; tangible user interface elements were designed with frog graphics; computational concepts such as arrays, conditional statements, Boolean values, and variables were embedded.

Research Outcomes

• What specific outcomes were achieved?

  • Field evaluations of Xylocode in a museum setting demonstrated its effectiveness in sparking learners' short-term interest (e.g., immediate enjoyment and exploration intentions) and fostering recognition of computer science.
  • The exhibit enabled learners to understand certain computational concepts, such as arrays and global variables.

• What advantages does it have compared to existing solutions?

  • It does not rely on programming syntax, lowering the learning threshold.
  • The use of tangible objects like frogs attracts interest from learners of various ages and backgrounds.
  • The multi-dimensional interactive experience design supports collaborative learning and addresses previous issues with high hardware failure rates.

• What were the experimental or evaluation results?

  • Interviews were conducted with 29 learners in the target age group (10-14 years), with over 90% of participants expressing interest in the exhibit and CS.
  • The average interaction time with the exhibit was 3 minutes and 55 seconds, exceeding the museum standard for Active Prolonged Engagement (APE).
  • Recognition rates for arrays and global variables were relatively high (69% and 55%, respectively), while recognition rates for Boolean values and conditional logic were lower.

• Limitations and Future Directions

  • Limitations: The number of participants was limited, and the study was conducted in only one museum. Participants generally had some CS background. Short-term evaluations could not measure long-term learning effects.
  • Future Directions:
    • Investigate interaction patterns among visitors with different backgrounds, experiences, and age groups.
    • Explore ecological connections between Xylocode and other related projects to expand learning impact.
    • Conduct in-depth analysis of visitor interaction data and learning dialogues to understand how Xylocode's design can further support CS learning.

This study makes a significant contribution to the design of informal computer science education interfaces that trigger interest and initial learning. It also inspires further exploration of tangible interaction design and museum exhibit design for children.