“Oh My God! It’s Recreating Our Room!” Understanding Children’s Experiences with A Room-Scale Augmented Reality Authoring Toolkit

Document Title

“Oh My God! It’s Recreating Our Room!” Understanding Children’s Experiences with A Room-Scale Augmented Reality Authoring Toolkit

Document Information

• Domain: Human-Computer Interaction (HCI), Augmented Reality (AR), Children's Education
• Keywords: Augmented Reality, Spatial AR, AR Authoring Toolkit, NetLogo AR, AR and Children, Participatory Design

Research Background and Issues

• Identified Issues or Challenges:

  • Many current augmented reality designs aim to support spatial thinking but often focus on device-based or marker-based AR, failing to fully leverage the rich spatial attributes of children's physical environments.
  • Existing AR systems cannot recognize and transform real environments at a room scale.
  • It remains unclear which factors in AR design can promote spatial exploration and create opportunities for spatial thinking.

• Significance:

  • Spatial thinking is a critical skill for STEM learning, and developing this ability can help children better understand complex spatial structures.
  • With technological advancements, room-scale AR technology offers a new possibility to enhance children's exploration and understanding of their environment.

• Motivation and Related Work:

  • The authors focus on studying how room-scale AR, combined with physical spaces and computational models, impacts children's spatial thinking and exploration.
  • Built on the NetLogo programming language, which features a low threshold and high ceiling, making it suitable for children's learning and creativity.

Solution

• Proposed Solution:

  • Develop NetLogo AR, an authoring toolkit combining room-scale AR with agent-based computational models, enabling children to design and create AR experiences.
  • Design a framework that supports spatial exploration, integrating room-scale and planar scanning unmarked AR modes.
  • Encourage children to interact physically with their environment, fostering the creation of AR experiences with spatial attributes.

• Innovations:

  • Overcoming the limitations of marker-based AR by using LIDAR and RoomPlan SDK to achieve dynamic room-scale AR creation with semantic attributes.
  • Directly integrating children's physical interactions into the design process, offering new learning opportunities.
  • Providing easily switchable AR/non-AR modes to help children engage in spatial thinking from both abstract and concrete perspectives.

• Implementation Steps and Technology:

  • Establish an agent-based computational model for NetLogo AR.
  • Use room scanning technology to integrate the attributes and positions of real-world objects into digital agents.
  • Design participatory activities such as scanning spaces, developing AR projects, and iterating on creations.

Research Outcomes

• Specific Outcomes:

  • Designed and implemented the NetLogo AR toolkit, enabling children to create AR experiences based on complex system models and physical space interactions.
  • Analyzed video data and design artifacts to understand children's interest and responses to room-scale AR, as well as spatial activity patterns during the creation process.
  • Proposed an AR design framework focused on user spatial movement and exploration behaviors.

• Advantages:

  • Stimulates children's interest in room-scale AR, promoting collaborative exploration and physical activity.
  • Provides dynamic interactions between physical and virtual worlds through technology, supporting children's deep engagement in spatial thinking activities.

• Experimental and Evaluation Results:

  • Found that room-scale AR significantly enhances children's spatial exploration, dynamic interactions, and creative behaviors.
  • In room-scale AR mode, children exhibited more physical movement, spatial exploration, and immersive behaviors.

• Limitations and Future Directions:

  • The study sample was small, including only seven children; future research should expand the participant pool and include children from diverse cultural and socioeconomic backgrounds.
  • Current technology faces challenges with device alignment and performance limitations; further hardware optimization is recommended to improve user experience.
  • Exploring the integration of NetLogo AR with curriculum targeting specific educational goals could create more structured learning scenarios.

This study provides valuable insights into future educational technology for children and the development of spatial thinking, laying the foundation for further exploration of the potential of room-scale augmented reality.