Extended Reality (XR) Remote Research: a Survey of Drawbacks and Opportunities

Title of the Paper

Extended Reality (XR) Remote Research: a Survey of Drawbacks and Opportunities

Paper Information

• Subject Area: Challenges and Opportunities of Extended Reality (XR) in Remote Research
• Keywords: Extended Reality, Virtual Reality, Augmented Reality, Literature Review, Expert Survey

Research Background and Issues

• Identified Problems or Challenges: XR technology is being widely used in human-computer interaction (HCI), social sciences, and psychology experiments, but its application in remote experiments remains significantly underdeveloped. Moreover, current XR remote experiments face multiple obstacles, including difficulties in participant recruitment, technical challenges due to device diversity, and safety concerns.
• Why It Matters: With the proliferation of consumer-grade XR hardware and the limitations on lab-based research caused by the COVID-19 pandemic, improving the adaptability of XR technology for remote experiments has become both urgent and important.
• Research Motivation and Related Work: Although some non-XR remote research has achieved success, such as large-scale data collection via online platforms, there is a lack of literature specifically addressing the performance and limitations of XR in remote research. Therefore, it is necessary to investigate XR researchers' perspectives and practices regarding remote experiments.

Solutions

• Methods or Solutions:
  • This paper explores the perspectives and practices of 46 XR researchers regarding remote XR research through a questionnaire survey.
  • A 30-question survey was used, covering aspects such as experimental design, participant recruitment, and data collection, combined with a literature review and thematic analysis of participants' responses.
• Innovations:
  • For the first time, a systematic summary of the advantages and disadvantages of XR technology in remote research is presented, along with comparisons to non-XR research.
  • A classification framework for remote XR research is proposed, categorizing experiments into "lab-essential," "lab-preferred," "remote-essential," and "remote-preferred" scenarios.
• Implementation Steps:
  • Design and distribute the questionnaire to academic communities and associations involved in virtual reality and augmented reality research.
  • Conduct thematic analysis based on the responses to identify key issues, common limitations, and nuanced perspectives in XR remote research.

Research Outcomes

• Specific Findings:
  • Summarized the main advantages of XR technology in remote experiments: portability, replicability of experimental scenarios, and built-in data collection features (e.g., eye tracking, motion tracking).
  • Identified major limitations: accessibility of hardware devices, challenges in data collection under wireless conditions, participant safety concerns, and issues with the reliability of experimental results.
  • Highlighted core challenges and future directions for improving remote XR research.
• Comparison with Existing Solutions:
  • While XR remote research offers unique advantages (e.g., sensor functions integrated into devices) compared to traditional methods, its reliance on complex hardware and associated technical and ethical issues currently hinder its ability to fully replicate the high-quality data of lab-based experiments.
• Experimental or Evaluation Results:
  • Significantly reduced the operational complexity of lab-based experiments, but remote research is affected by uncontrollable variables such as data quality and environmental interference.
  • Certain functionalities (e.g., capturing psychophysiological signals) are difficult to achieve remotely due to hardware limitations.
• Limitations and Future Directions:
  • Address the challenge of recruiting a sufficiently large and representative XR user base.
  • Investigate the differences between remote and lab-based experimental results to assess the reliability and value of remote research.
  • Advocate for the development of standardized toolkits leveraging XR hardware's data collection capabilities to lower technical barriers for researchers.
  • Explore the potential of XR technology as a data collection tool and optimize research questions to align with its technical characteristics.

Summary and Recommendations

Based on thematic analysis, this paper proposes five key questions to advance XR remote research:

1. Who are the potential participants for remote XR research, and are they representative?
2. How can a large-scale participant pool for remote XR research be established?
3. How does remote XR research impact experimental results, and how does it differ from lab-based experiments?
4. What built-in data collection features do XR hardware offer, and what research questions can they address?
5. How can the technical barriers to creating "encapsulated" experiments be reduced to maximize the potential of remote XR research?

These recommendations provide significant insights for the future application of XR technology in remote experiments within fields such as human-computer interaction and psychology.