Player Safety by Design: Co-Designing Child-Centered Safety Mechanisms with Children

Paper Title

Player Safety by Design: Co-Designing Child-Centered Safety Mechanisms with Children

Publication Info

• Topic area: Child-centered safety design for user-generated game platforms.
• Keywords: Safety-by-design, user-generated games, child safety, co-design, online risks, community accountability, player empowerment, Roblox, age-appropriate design, psychological inoculation.

Background and Problem

• Problem / challenge: Existing safety mechanisms in user-generated game (UGG) platforms like Roblox fail to adequately address children’s safety needs, often shifting the burden of managing risks onto children themselves. Current interventions lack children’s perspectives and fail to integrate safety into the design process.
• Significance: UGG platforms are highly popular among children but present unique risks, including inappropriate content, scams, and predatory monetization. Addressing these risks is critical to ensuring safe and enjoyable play environments for children.
• Motivation and related work: Prior work has focused on technical interventions, parental mediation, and ethical frameworks, but these approaches often neglect children’s voices. Safety-by-design research emphasizes embedding harm prevention into design, yet it has rarely involved children directly in the process. This study seeks to fill this gap by exploring how children envision safety mechanisms on UGG platforms.

Solution

• Proposed approach: A cooperative inquiry (CI) study involving 22 children aged 7–12 to co-design safety mechanisms for Roblox, a popular UGG platform.
• Novelty:
  1. Highlights children’s perspectives on safety-by-design, spanning both game-level and platform-level mechanisms.
  2. Examines how children allocate trust across platforms, creators, and peers, shaping their expectations for safety design.
  3. Introduces the concept of controlled risk exposure to balance safety and enjoyable play.
  4. Proposes collaborative safety models that combine platform support with children’s agency.
• Procedure and key techniques:
  • Conducted three workshops using CI methods such as “play and tell,” comic book creation, and prototyping.
  • Explored children’s experiences with unsafe scenarios, brainstormed design solutions, and created prototypes.
  • Analyzed data through thematic analysis, identifying four key design patterns: information transparency, community accountability, player empowerment, and age-appropriate navigation.

Results

• Concrete findings:
  • Children proposed safety mechanisms emphasizing clear warnings, accurate game descriptions, upfront purchase disclosures, robust reporting features, detailed player reviews, tools for managing social boundaries and engagement, and age-appropriate navigation systems.
  • Four key themes emerged: information transparency, community accountability, player empowerment, and age-appropriate game navigation.
• Advantage over baselines: The study foregrounds children’s perspectives, offering nuanced insights into safety mechanisms that balance protection with agency and fun. It extends safety-by-design research to UGG platforms, addressing gaps in existing interventions.
• Experiments / evaluation:
  • Workshops involved 22 children aged 7–12 (M=9.22, SD=1.53), using methods like contextual inquiry, comic book creation, and prototyping.
  • Data included 240 minutes of group recordings, 1,320 minutes of breakout group recordings, 89 comic book scenes, 42 design sketches, and 87 sticky notes.
  • Findings were analyzed using thematic analysis to identify patterns in children’s safety concerns and design ideas.
• Limitations and future work:
  • Small sample size limits generalizability; future studies could expand participation or use mixed methods.
  • Gender imbalance in participants may skew findings; future research could ensure balanced representation.
  • Focused on Roblox; findings may need adaptation for other UGG platforms.
  • Primarily addressed children under 13; future work could explore older adolescents’ perspectives.

Summary

This study explores how children aged 7–12 envision safety mechanisms for user-generated game platforms like Roblox. Through cooperative inquiry workshops, children proposed design patterns emphasizing information transparency, community accountability, player empowerment, and age-appropriate navigation. The findings highlight children’s desire for controlled risk exposure, trust in community feedback, and collaborative safety models that balance platform support with their agency. The study underscores the importance of embedding safety-by-design into UGG platforms and suggests that psychological inoculation could help children build resilience while enjoying engaging play. Future work should expand the scope to other platforms and age groups to validate and refine these insights.