"The System is Made to Inherently Push Child Gambling in my Opinion": Child Safety, Monetization, and Moderation on Roblox

Research Background and Issues

• What problems or challenges did the authors identify?
  User-generated platforms like Roblox are highly popular among children but have been criticized for potential safety risks, such as gambling-like game mechanics, racist role-playing, and sexual harassment. Additionally, research indicates that creators on these platforms may intentionally or unintentionally introduce risks in game design, but there has been limited focus on how creators consider children's safety in their design practices.

• Why is this issue important?
  A significant portion of Roblox's user base consists of children, with 58% being under the age of 16. Children on the platform are exposed to unmoderated content, such as gambling-like functional designs, fraud, or other inappropriate material. These designs can directly or indirectly threaten children's mental health, financial security, and even physical safety.

• Research Motivation and Related Work
  While there is extensive research on online child safety (e.g., information leakage, online harassment, and exposure to sensitive content), user-generated games present unique complexities. The interactivity and design flexibility of these platforms make risks harder to detect. Few studies have examined how creators perceive and manage these risks in their development practices. Therefore, this paper addresses two core research questions:

  1. How do game creators perceive child safety risks in their design practices?
  2. What causes these child safety risks?

Solutions

• What methods or solutions did the authors propose?
  The authors conducted semi-structured interviews with 20 Roblox game creators to explore how they perceive and manage child safety. The interview data were analyzed thematically, identifying four main types of child safety risks and three primary causes of these risks.

• What is innovative about this solution?
  This study is the first to reveal creators' perspectives during the design process, particularly how they balance economic motivations with social responsibility. It highlights micro-level practices from the participants' viewpoints and places game creators at the center of child safety research and UGG (user-generated games) governance. The study also provides specific recommendations for governance and policy-making.

• What are the implementation steps and key techniques used?
  The research was conducted through the following steps:

  1. Data Collection: Creators with diverse backgrounds were recruited via Reddit, Discord communities, and university student organizations.
  2. Semi-Structured Interviews: Focused on creators' game design experiences, awareness of child safety, and strategies for addressing safety challenges.
  3. Data Analysis: Employed inductive thematic analysis to summarize the main risks observed by creators.

Research Findings

• What specific findings were achieved?

  • Main Types of Risks:

    1. Child-Specific Deceptive Designs: Using visual effects and game mechanics to capture children's attention and induce spending.
    2. Gambling-Like Gameplay: Designs such as loot boxes that covertly mimic gambling behaviors.
    3. Sexual Exploitation Risks: Including inappropriate content designs and predators using the platform to contact children.
    4. Fraudulent Activities: Scams targeting children and transactions outside the platform to acquire children's accounts.

  • Main Causes:

    1. Profit-Driven Creator Economy: Roblox's algorithms and incentive structures prioritize revenue generation, encouraging creators to use potentially harmful designs to attract children's spending.
    2. Decentralized Regulatory Infrastructure: The platform shifts regulatory responsibilities to creators but provides limited support, leading to ineffective oversight.
    3. Regional Variations in Safety Standards: The platform adjusts safety standards based on different countries' regulations, but this differentiated approach is seen as inconsistent and flawed.

• What were the experimental or evaluation results?

  • Creators in the study sometimes employed risky designs driven by economic incentives but also expressed concerns about work ethics and child safety.
  • Many creators criticized the platform's regulatory mechanisms, highlighting deficiencies in algorithms, resource support, and tracking violators.

• What advantages does it have compared to existing solutions?
  This study emphasizes the creators' perspectives, enabling academia and policymakers to better understand the sources of risks. It also advocates for a multi-stakeholder governance model, expanding the discussion on platform governance and child safety.

• Limitations and Future Directions

  1. The sample focuses on creators, with limited attention to other stakeholders (e.g., child players, parents).
  2. Future research is encouraged to explore children's self-protection capabilities and collaborative mechanisms involving more stakeholders (e.g., policymakers and parents).
  3. Practically, the study suggests developing cross-platform information-sharing tools and stronger creator support systems to enhance governance capabilities.

In summary, this study systematically reveals the complexities of child safety issues on the Roblox platform and the challenges and improvement directions from the creators' perspective. It provides valuable insights and practical options for online child protection and platform governance.