Examining Design Choices of Questionnaires in VR User Studies
Authors
Questionnaires are among the most common research tools in virtual reality (VR) user studies. Transitioning from virtuality to reality for giving self-reports on VR experiences can lead to systematic biases. VR allows to embed questionnaires into the virtual environment which may ease participation and avoid biases. To provide a cohesive picture of methods and design choices for questionnaires in VR (inVRQ), we discuss 15 inVRQ studies from the literature and present a survey with 67 VR experts from academia and industry. Based on the outcomes, we conducted two user studies in which we tested different presentation and interaction methods of inVRQs and evaluated the usability and practicality of our design. We observed comparable completion times between inVRQs and questionnaires outside VR (nonVRQs) with higher enjoyment but lower usability for \inVRQs. These findings advocate the application of inVRQs and provide an overview of methods and considerations that lay the groundwork for inVRQ design.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 71%
Quantifying the Novelty Bias when Evaluating Interactive Prototypes
CHI '26· User Research Methods (Interviews, Surveys, Observation) +2
- 67%
How Do We Measure That?! Quick Scale Development
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 67%
A Bermuda Triangle? - A Review of Method Application and Triangulation in User Experience Evaluation
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 67%
Designing with the Mind in Mind: The Psychological Basis for UI Design Guidelines
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 67%
Balanced Interaction Design
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 67%
The Meaning of Interactivity—Some Proposals for Definitions and Measures
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 67%
Technology Acceptance and User Experience: A Review of the Experiential Component in HCI
CHI '18· User Research Methods (Interviews, Surveys, Observation) +1
- 67%
A Practice-Led Account of the Conceptual Evolution of UX Knowledge
CHI '19· User Research Methods (Interviews, Surveys, Observation) +1
- 67%
Psychometric Properties of the User Experience Questionnaire (UEQ)
CHI '22· User Research Methods (Interviews, Surveys, Observation) +1
- 67%
Behavioral Differences between Tap and Swipe: Observations on Time, Error, Touch-point Distribution, and Trajectory for Tap-and-swipe Enabled Targets
CHI '24· User Research Methods (Interviews, Surveys, Observation) +1
Based on Jaccard similarity of research subtopics & professions (≥60%)