Avatar-Mediated Communication in Social VR: An In-depth Exploration of Older Adult Interaction in an Emerging Communication Platform

Document Title

Avatar-Mediated Communication in Social VR: An In-depth Exploration of Older Adult Interaction in an Emerging Communication Platform

Document Information

• Subject Area: Research on Social Virtual Reality (Social VR) and technology interaction for older adult users
• Keywords: Virtual reality, social interaction, older adults, avatars, social isolation, behavioral humanization, participatory design, communication technology, user experience, nonverbal communication

Research Background and Issues

• Identified Problems or Challenges:

  1. Current research on older adults using avatar-mediated communication (AMC) in social virtual reality is relatively scarce, with most studies focusing on screen-based virtual worlds (e.g., Second Life).
  2. Nonverbal communication in 3D avatars is lacking in human-computer interaction, leading to functional limitations.
  3. Previous experimental cycles were relatively short, failing to explore long-term user experiences in depth.
  4. Some older adults face technological barriers, such as unfamiliarity with head-mounted displays (HMDs) and control devices.

• Importance of the Issues:

  1. Older adults represent a rapidly growing demographic whose social needs and technological adaptability require deeper understanding, especially in the context of social isolation caused by the COVID-19 pandemic.
  2. Virtual reality (VR) technology offers a viable tool to enhance social participation and reduce feelings of loneliness among older adults.

• Research Motivation and Related Work:

  1. Introducing AMC and immersive social VR may improve communication experiences for older adults.
  2. Building on prior participatory research findings, the study explores virtual communication systems designed based on older users' needs.
  3. Addressing gaps in understanding AMC in fully immersive VR and verifying its potential role in alleviating social isolation among older adults.

Solutions

• Proposed Methods or Solutions:

  1. Development and evaluation of a social virtual reality prototype platform called "School Days," which allows users to engage in school-themed virtual interactions through avatars.
  2. Incorporation of Participatory Action Research (PAR), collaborating with 16 older participants to design and evaluate the system.
  3. Optimization of avatar expressiveness and behavioral humanization, including features like lip synchronization, gaze simulation, and diverse avatar customization options.

• Innovative Aspects of the Solutions:

  1. Integration of behavioral humanization design, such as nonverbal cues and facial expression control, to enhance communication authenticity.
  2. Systematic approach involving participatory design, user co-development, and cross-regional testing (150 km spatial distance).
  3. Exploration of technology's potential to support social participation among introverted older adults, specifically addressing social isolation.

• Implementation Steps and Key Technologies:

  1. Design of two types of avatars: realistic avatars (based on real appearances) and cartoon avatars (personalized designs).
  2. Creation of virtual interaction scenarios, including school classroom environments and various interactive tools (e.g., 3D objects, virtual holographic stories).
  3. Comprehensive testing of system functionalities using head-mounted displays (Oculus Rift), precision tracking technology, and interactive interfaces.
  4. Evaluation through semi-structured interviews, observation records, and presence questionnaires.

Research Findings

• Specific Findings:

  1. Improved User Experience: AMC was perceived as an environment conducive to expressing sensitive topics, particularly beneficial for less extroverted users.
  2. Behavior and Social Connection: AMC supported users in establishing social connections within virtual environments, including exploring shared interests during initial meetings.
  3. Design Guidelines: Six design reflections were proposed, such as leveraging closed social VR environments to enhance privacy and security while avoiding overly complex emotional control interfaces.

• Comparative Advantages Over Existing Solutions:

  1. Four notable advantages include: supporting discussions of sensitive topics, enhancing anonymity, amplifying introverted users' voices, and addressing attention distractions in video conferencing.
  2. User feedback indicated that AMC performed better in emotional expression and nonverbal communication compared to earlier screen-based virtual world experiences.

• Experimental or Evaluation Results:

  1. Presence was measured using a modified version of Witmer and Singer's presence questionnaire, with 56.1% of participants reporting that the virtual environment felt consistent with real-world experiences.
  2. Manual control of emotional expression features revealed shortcomings, including complexity in operation and a need for usability improvements.

• Limitations and Future Directions:

  1. Restricted to laboratory settings, future research could focus on "field" applications in homes or nursing facilities.
  2. Suggests comparing social VR with other technologies like video conferencing to systematically explore respective advantages.
  3. Further development of automatic emotion recognition and expression technologies to enhance user immersion and ease of use.

Summary and Recommendations

This study highlights the potential for advancing research on older adults' technological adaptation and social interaction, showcasing social VR as a novel avenue for supporting vulnerable populations (e.g., socially isolated older adults). It also emphasizes the importance of direct collaboration with end users.