A Postmortem on Playtesting: Exploring the Impact of Playtesting on the Critical Reception of Video Games
Authors
Game studios aim to develop titles that deliver a fun and engaging experience for players. Playtesting promises to help identify opportunities to improve player experience and assist developers in achieving their design intent. However, a lack of research on the added value of playtesting means that many studios are still uncertain about its commercial viability and impact on product success. This gap in understanding is further complicated by the vague definition of "success" afforded by sales figures and review scores. In this paper, we assess reported feature quality of three commercial titles by analyzing playtesting reports and game reviews. By comparing themes and design issues expressed in game reviews to the results of pre-release playtesting for each game, we aim to highlight the value of playtesting and propose a set of guidelines for selecting playtest methods based on the needs of a given game evaluation. Through the real-world case studies presented, this paper contributes to the growing domain of games user research and highlights the value of playtesting in game development.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 75%
Video Game Selection Procedures For Experimental Research
CHI '18· Game UX & Player Behavior +1
- 67%
"Do I Really Need This?": Illuminating Challenges in Integrating Computational Training Tools in Esports Coaching
CHI '26· Game UX & Player Behavior +2
- 60%
Designing for Transformative Play
CHI '18· Game UX & Player Behavior +1
- 60%
Recognizing Affiliation: Using Behavioural Traces to Predict the Quality of Social Interactions in Online Games
CHI '20· Game UX & Player Behavior +1
- 60%
Restorative Play: Videogames Improve Player Wellbeing After a Need-Frustrating Event
CHI '20· Game UX & Player Behavior +1
- 60%
Gathering Self-Report Data in Games through NPC Dialogues: Effects on Data Quality, Data Quantity, Player Experience, and Information Intimacy
CHI '21· Game UX & Player Behavior +1
- 60%
Press A to Jump: Design Strategies for Video Game Learnability
CHI '22· Game UX & Player Behavior +1
- 60%
Generating Real-Time, Selective, and Multimodal Haptic Effects from Sound for Gaming Experience Enhancement
CHI '23· Vibrotactile Feedback & Skin Stimulation +1
- 60%
Long-Term Effects of User Expertise and Application Design on Collision Anxiety in VR Games
CHI '25· Immersion & Presence Research +1
Based on Jaccard similarity of research subtopics & professions (≥60%)