MR.Brick: Designing A Mixed-reality Educational Game System for Promoting Children's Remote Social & Collaborative Skill

Document Title

MR.Brick: Designing A Remote Mixed-reality Educational Game System for Promoting Children’s Social & Collaborative Skills

Document Information

• Subject Area: Mixed reality technology, children's education, remote collaborative design
• Keywords: Mixed reality, tangible user interface, remote collaboration, children, educational games, social and collaborative skills

Research Background and Issues

• Identified Problems and Challenges:

  • Social isolation caused by the COVID-19 pandemic has severely impacted the development of children's social and collaborative skills.
  • Current remote collaboration systems primarily focus on interactions between children and adults, with few tools specifically designed to support remote collaboration among children.
  • Existing collaborative systems for children are either overly complex or fail to adequately address the challenges of remote collaboration.
  • Children face cognitive and emotional limitations during remote collaboration, making social interactions more difficult.

• Importance of the Problem:

  • The lack of systems supporting children's remote collaboration not only affects their current cognitive and emotional development but also poses threats to their long-term social and academic performance.
  • Helping children overcome the negative effects of isolation can enhance their mental health, learning abilities, and social adaptability.

• Research Motivation and Related Work:

  • Fully leveraging the potential of mixed reality (MR) and tangible user interfaces (TUI) to improve children's collaboration and social interactions.
  • Exploring interaction designs and educational tools tailored to children's developmental characteristics to address the shortcomings of existing systems.

Solution

• Proposed Solution/Design:

  • Introduced a mixed-reality educational game system called MR.Brick, which combines MR technology and tangible interaction techniques to help children develop remote collaboration skills.
  • Designed game rules and interaction mechanisms based on cognitive science, developmental psychology, and cognitive load theory.
  • Proposed six design guidelines, including shared task space, enhanced non-verbal interaction, unconscious operation based on input modes, role assignment and collaboration, adaptive support, and child-friendly interaction optimization.

• Innovative Features:

  • Utilized MR and TUI technologies to provide children with a more intuitive and immersive remote collaboration experience.
  • Designed a collaboration mechanism based on "Lego therapy," assigning explicit roles (e.g., "supplier" and "builder") within the game to encourage information sharing and collaboration among children.
  • Optimized the system interface and interactions tailored to children's cognitive and manual abilities while balancing usability and challenge.

• Implementation Steps and Key Technologies:

  1. For shared space, utilized physical boards and tools with AR recognition patterns to provide a real-time collaborative environment.
  2. Provided video chat functionality to compensate for the lack of non-verbal cues in remote collaboration.
  3. Employed AR recognition technology based on Vuforia and implemented precise physical-virtual interactions using Unity3D.
  4. Developed in-game guiding characters (e.g., Mr. Brick) to offer real-time feedback and operational guidance.

Research Outcomes

• Specific Results:

  • Compared to traditional video games, MR.Brick provided children with more active emotional engagement, behavioral participation, and verbal communication (e.g., more frequent discussions and emotional expressions).
  • MR.Brick's design significantly improved task completion efficiency and accuracy in collaborative activities.
  • Participants showed notable improvements in various social and collaborative skills (e.g., team dynamics, contribution levels, problem-solving abilities) after using the MR game.

• Advantages Over Existing Solutions:

  • Compared to traditional video games, MR.Brick better simulates real-world building scenarios and reduces children's cognitive load through tangible tools.
  • The game successfully enhanced teamwork among children by enforcing role alternation and information sharing.

• Experimental Evaluation Results:

  • Task completion efficiency (382.83 seconds vs. 382.13 seconds) and accuracy (65.49% vs. 61.75%) were slightly better than traditional video games.
  • Children reported a stronger preference for playing MR games frequently in the future, with significant improvements in their social skills scores post-experiment.
  • MR.Brick scored higher overall in behavioral/emotional engagement and willingness to continue using the system.

• Limitations and Future Directions:

  • Current experiments only studied the short-term effects of the game; future research should conduct long-term experiments to verify the system's sustained impact on children's social and collaborative skill development.
  • On the technical side, the system currently relies on multiple devices (e.g., several cameras); future research should simplify hardware configurations to improve usability.
  • Further development of free-building modes could stimulate children's creativity, and a mobile version could enhance accessibility.
  • Optimizing the 3D operation interface will be a key focus for future research, especially to help children better understand spatial relationships.

Conclusion

MR.Brick provides an innovative mixed-reality educational tool that enhances children's performance in remote collaboration. This study not only contributes a novel interaction system but also offers systematic recommendations for designing remote interaction tools for children. Additionally, it demonstrates the broad application potential of mixed reality and tangible user interfaces in the educational domain.