Socially Late, Virtually Present: The Effects of Transforming Asynchronous Social Interactions in Virtual Reality

Title of the Paper

Socially Late, Virtually Present: The Effects of Transforming Asynchronous Social Interactions in Virtual Reality

Paper Information

• Topic Area: Social interactions in Virtual Reality (VR), asynchronous interaction, and transformations of gaze and spatial behaviors
• Keywords: Virtual Reality, transformed social interaction, social interaction, proxemics, eye gaze

Research Background and Issues

• What problems or challenges did the authors identify?

  • Most current social VR interactions occur in real-time, with limited research on asynchronous social interaction tools.
  • In asynchronous scenarios, integrating new users into previously recorded interactions is challenging; simple reproduction may result in a "spectator" experience for new users rather than making them feel like true members of the group.
  • The importance of nonverbal signals (e.g., gaze and spatial behaviors) in virtual interactions has not been extensively studied in asynchronous contexts.

• Why is this issue important?

  • Asynchronous social VR combines the convenience of asynchronous communication with the high sense of presence offered by VR, holding significant potential for applications such as education, remote meetings, and cross-time-zone group interactions.
  • Enhancing the sense of immersion and social belonging for new users in recorded environments could greatly improve the user experience of asynchronous VR.

• Research Motivation and Related Work

  • The motivation lies in exploring and developing transformation techniques for nonverbal signals (e.g., spatial adjustments and gaze insertion) to help new users integrate more effectively into recorded interaction content.
  • Related work includes studies on spatial behaviors and gaze in synchronous virtual interactions and their effects, but research on how recorded social interactions in asynchronous settings can better engage users is very limited.

Solution

• What methods or solutions did the authors propose?

  • Proposed nonverbal behavior transformation techniques: adjusting spatial behaviors in recorded social interactions to reposition new users in a more natural and integrated manner; inserting synthetic gaze behaviors to enhance the sense of presence and perceived attention.
  • Introduced four transformation conditions for recorded discussions:
    1. Unaltered original recording (baseline).
    2. Spatial adjustment only (equalizing new users' distance within the group).
    3. Spatial adjustment with gaze insertion.
    4. Closer spatial adjustment with gaze insertion.

• What are the innovative aspects of this solution?

  • Combined spatial adjustments and direct gaze insertion to enhance users' sense of presence and group belonging.
  • Focused on the underexplored domain of asynchronous interaction, proposing a new modeling framework that incorporates the temporal dimension into the field of Transformed Social Interaction (TSI).

• What are the implementation steps and key technologies used?

  1. Recorded test scenarios (group discussions) using the ENGAGE platform.
  2. Applied spatial behavior adjustments (repositioning users for equal distance distribution) and gaze behavior insertion to the recorded social interactions.
  3. Set experimental conditions: randomly assigned 128 participants to the four conditions mentioned above, evaluating their subjective perceptions and behavioral responses.
  4. Collected subjective and objective data such as sense of presence, perceived attention, head movement data (rotation and displacement), and gaze behavior data.

Research Findings

• What specific findings were obtained?

  • The combination of spatial adjustment and gaze insertion significantly enhanced users' social presence and perceived attention.
  • Found that closer distances (within intimate zones) may increase perceived threat levels.
  • Behavioral analysis revealed that adding gaze behaviors increased users' head rotation and movement toward the group center, indicating more active engagement in such scenarios.

• What advantages does it have compared to existing solutions?

  • This study improved user experience based on real recordings by adding nonverbal signals, rather than relying entirely on fully automated virtual agents.
  • Proposed practical design guidelines for asynchronous recordings that can be directly applied to real-world scenarios such as education and online meetings.

• What were the experimental or evaluation results?

  • Conditions 3 (spatial adjustment + gaze insertion) and 4 (closer distance + gaze insertion) significantly enhanced social presence and mutual gaze behaviors.
  • Participants reported more mutual gaze under conditions with gaze transformations, but the duration of direct gaze (non-feedback viewing behavior) showed no significant differences across conditions.
  • Direct gaze insertion targeting new users, especially at closer distances, may carry risks of increasing perceived threat.

• Limitations and Future Directions

  • Limitations:
    • The system did not use devices equipped with eye-tracking, resulting in less precise data collection.
    • The sample population for the experiment was concentrated among university students, limiting representativeness.
    • The study could not directly control for the impact of diversity in virtual identities (e.g., age, racial representation) on the results.
  • Future Directions:
    • Apply the study to a broader participant pool and use VR devices with eye-tracking capabilities.
    • Test the current transformation techniques in more dynamic interaction scenarios (e.g., gaze behaviors and spatial adjustments during multi-person movements).
    • Introduce more complex roles (virtual agents) and transformations of verbal behaviors.