Prevalence and Salience of Problematic Microtransactions in Top-Grossing Mobile and PC Games: A Content Analysis of User Reviews

Title of the Paper

"The Prevalence and Salience of Problematic Microtransactions in Top-Grossing Mobile and PC Games: A Content Analysis of User Reviews"

Bibliographic Information

• Research Domain: Game design and player experience studies, focusing on the impact of microtransactions on player experience and ethical concerns
• Keywords: Microtransactions, mobile games, dark patterns, player experience, ethics, top-grossing games, game monetization
• Conference: ACM CHI 2022 (a premier conference in the field of Human-Computer Interaction)
• DOI: 10.1145/3491102.3502056

Research Background and Problem Statement

• Identified Problems or Challenges:

  1. The proliferation of microtransactions is reshaping game design and player experience, sparking ethical debates.
  2. Existing research primarily focuses on loot boxes, neglecting other forms of microtransactions that may also pose issues.
  3. It remains unclear which forms of microtransactions are perceived by players as the most prevalent and problematic.
  4. Issues raised by players in game reviews may be misaligned with current academic and regulatory priorities.

• Significance of the Research:

  • Microtransactions play a crucial role in driving global game revenue and player growth, particularly in mobile games.
  • Identifying the most impactful forms of microtransactions on players can aid in designing more ethical and user-friendly games, as well as establishing appropriate regulatory frameworks.

• Motivation and Related Work:

  • Previous studies have analyzed the potential issues of microtransactions from ethical and legal perspectives but have overlooked players' direct experiences and perceptions.
  • Players may be particularly sensitive to certain forms of microtransactions (e.g., impacts on fairness and gameplay experience), which have not been adequately explored in existing literature.
  • The authors aim to uncover the real impact of microtransactions on player experience through negative user reviews, providing valuable insights for policymakers and game designers.

Solution

• Methodology:

  • Data Source: Extracted 801 negative user reviews from 50 top-grossing games on Google Play Store (mobile games) and Steam (PC games).
  • Analysis Approach: Conducted a directed content analysis of the reviews using a pre-established taxonomy of microtransaction issues (comprising 35 categories generated from the player perspective).
  • Key Variables:
    • "Prevalence" of microtransactions (frequency of a specific technique being used in games).
    • "Salience" of microtransactions (proportion of negative reviews mentioning a specific technique).

• Implementation Steps:

  1. Data Preprocessing: Removed reviews unrelated to monetization issues, as well as offensive or ambiguous comments (e.g., unclear acquisition methods for virtual currency).
  2. Classification and Annotation: Coded and labeled each review based on technical features using the existing taxonomy.
  3. Frequency Analysis: Analyzed the distribution frequency of different microtransaction techniques by platform and type.
  4. Salience Calculation: Assessed the salience of specific techniques based on their mention rates in negative reviews.

• Innovations:

  • Shifted the focus from loot boxes to other forms of microtransactions.
  • Adopted a player experience-based perspective (user reviews) rather than purely legal or ethical viewpoints.
  • Spanned both mobile and PC gaming platforms to reveal significant cross-platform differences.

Research Findings

• Specific Results:

  1. Prevalence of Microtransactions:
     • At least one problematic microtransaction was identified in 88% of mobile games and 28% of PC games.
     • Common issues in mobile games included "design driving spending," "misrepresentation of products," and "pay-to-enhance experience," while PC games predominantly featured "core content locked behind paywalls" and "design-driven payments."
  2. Salience of Microtransactions:
     • In mobile games, "misrepresentation of products" was the most salient (salience value of 0.18), followed by "pay-or-wait" and "pay-to-enhance game experience."
     • In PC games, "core content locking" was the most salient (salience value of 0.12).

• Comparison with Existing Solutions:

  • Unlike existing research that focuses on loot boxes, this study highlights broader concerns among players, such as fairness, degraded user experience, and transparency issues.
  • It underscores the higher prevalence and complexity of problematic monetization in mobile games.

• Experimental or Evaluation Results:

  • The reliability of the taxonomy was validated using Krippendorf's alpha (0.81).
  • Confirmed that mobile games employ a wider variety of problematic microtransaction techniques more frequently than PC games.

• Limitations and Future Directions:

  1. Limitations:
     • Relied solely on publicly available negative player reviews, which may not fully represent the views of all players.
     • Focused on top-grossing games, potentially overlooking the diversity found in indie games.
     • Reviews were limited to English, introducing cultural and regional biases.
  2. Future Research Directions:
     • Expand to include more gaming platforms (e.g., console games) and non-English-speaking audiences.
     • Investigate the relationship between players' actual spending behavior and their attitudes toward microtransactions.
     • Further explore which monetization methods align better with players' expectations for fairness in gaming experiences.