A Bermuda Triangle? - A Review of Method Application and Triangulation in User Experience Evaluation
Honorable MentionAuthors
User experience (UX) evaluation is a growing field with diverse approaches. To understand the development since previous meta-review efforts, we conducted a state-of-the-art review of UX evaluation techniques with special attention to the triangulation between methods. We systematically selected and analyzed 100 papers from recent years and while we found an increase of relevant UX studies, we also saw a remaining overlap with pure usability evaluations. Positive trends include an increasing percentage of field rather than lab studies and a tendency to combine several methods in UX studies. Triangulation was applied in more than two thirds of the studies, and the most common method combination was questionnaires and interviews. Based on our analysis, we derive common patterns for triangulation in UX evaluation efforts. A critical discussion about existing approaches should help to obtain stronger results, especially when evaluating new technologies.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
How Do We Measure That?! Quick Scale Development
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 100%
The Meaning of Interactivity—Some Proposals for Definitions and Measures
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 100%
Technology Acceptance and User Experience: A Review of the Experiential Component in HCI
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 100%
Psychometric Properties of the User Experience Questionnaire (UEQ)
CHI '22· User Research Methods (Interviews, Surveys, Observation) +1
- 100%
Deriving Selection Techniques for GUIs based on the Multiple Process Model
CHI '25· User Research Methods (Interviews, Surveys, Observation) +1
- 100%
Developing Persona Analytics Towards Persona Science
IUI '22· User Research Methods (Interviews, Surveys, Observation) +1
- 100%
How Problematic Are Suspenseful Interactions?
MobileHCI '25· User Research Methods (Interviews, Surveys, Observation) +1
- 75%
Evaluation Strategies for HCI Toolkit Research
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 75%
How Do We Measure That?! Quick Scale Development
CHI '18· User Research Methods (Interviews, Surveys, Observation)
- 75%
Empirical Research Methods for Human-Computer Interaction
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
Based on Jaccard similarity of research subtopics & professions (≥60%)