Haptic Biosignals Affect Proxemics Toward Virtual Reality Agents

Research Background and Issues

• What problems or challenges did the authors identify?

  • In virtual reality (VR) interactions with virtual agents, there is currently a lack of tactile sensory dimensions related to human touch. Although digital biosignal communication can mediate virtual social interactions, it remains unclear how artificial tactile biosignals influence users' spatial distance in VR.
  • Existing research on proxemics and sensory feedback is primarily conducted in real-world or augmented reality environments, with limited exploration of how tactile feedback affects proxemics in virtual spaces.

• Why is this issue important?

  • Spatial distance in virtual social environments is significant as it impacts individuals' comfort, emotional connection, and the quality of social interactions.
  • Understanding how tactile feedback influences proxemics can enhance immersion and social experiences in VR while improving the practical design of virtual agents.

• Research Motivation and Related Work

  • The widespread use of VR social systems necessitates further investigation into the influence of nonverbal signals on proxemics, particularly the role of tactile signals.
  • The study draws inspiration from the design concepts of interpersonal emotional touch, such as vibrotactile heartbeats and thermal feedback, which are associated with emotions and comfort in real-world contexts.

Solution

• What methods or solutions did the authors propose?

  • The authors designed two tactile feedback modes simulating virtual agents' biosignals: vibrotactile heartbeat feedback and thermal body temperature feedback. These modes aim to simulate the physiological characteristics of virtual agents to observe users' spatial reactions.
  • The study conducted an experiment with 31 participants to explore the multifactorial effects of tactile feedback and agent storytelling.

• What is innovative about this solution?

  • Introduced the new concept of "haptic biosignal proxemics," linking non-visual biosignals to interactions with virtual agents.
  • Explored how multimodal tactile signals combining vibration and thermal feedback influence users' proxemics and immersion, driving innovation in haptic interaction design.
  • The study scenario was designed based on Hall's four spatial zones of proxemics (public zone, social zone, personal zone, intimate zone) and dynamically provided feedback on users' spatial positions.

• What are the implementation steps and key technologies used?

  1. Experimental Design: Introduced two independent variables (tactile feedback: None, Thermal, Vibrotactile, Thermal+Vibration; agent storytelling: negative, neutral, positive) using a Latin square design to balance experimental conditions.
  2. Hardware:
     • The vibration mode utilized the vibration component of the Oculus Touch controller to simulate the agent's heartbeat signal.
     • The thermal mode used Peltier elements to deliver body temperature sensations across different ranges.
  3. Virtual Environment: Created a forest scene and a standardized virtual agent, incorporating dynamic voice storytelling generated using GPT-3 and text-to-speech conversion technology.
  4. Measurement Methods: Included objective interpersonal distance, subjective distance ratings, perceived arousal levels, and post-trial comfort ratings.
  5. Data Collection and Analysis: Used mixed-effects linear models to analyze the interaction effects between tactile feedback and storytelling.

Research Findings

• What specific findings were obtained?

  • Thermal feedback reduced actual spatial distance (objective distance) but did not significantly affect subjective distance, while vibrotactile feedback increased both subjective and objective distances.
  • Vibrotactile heartbeat signals increased arousal levels but decreased comfort, whereas thermal feedback did not significantly increase discomfort.
  • Although tactile feedback conditions did not significantly affect immersion ratings during the experiment, tactile signals were found to have a significant impact on individuals' bodily perception, triggering experiences of separation between internal and external sensations.

• What advantages does it have compared to existing solutions?

  • This study is the first to integrate tactile biosignals into the study of proxemics in virtual reality spaces. Compared to previous unimodal studies (e.g., visual or auditory), it focuses more on the potential of touch as a nonverbal behavior.
  • The multimodal feedback design (simultaneous use of thermal and vibrotactile feedback) provides practical insights into achieving more natural and diverse interaction signals.

• What are the experimental or evaluation results?

  • Participants generally remained in the "social zone," avoiding moving closer to the virtual agent into the "personal" or "intimate" zones.
  • Some participants perceived biosignals as making the virtual agent feel more "alive," while others experienced discomfort akin to the "uncanny valley effect."
  • Qualitative data revealed the ambiguity and multiple interpretations of tactile signals, which could further influence user experience design.

• Limitations and Future Directions

  • Limitations:
    1. The physiological authenticity of simulated signals is limited; future research could use real-time biosignal data.
    2. The experiment did not account for additional influencing factors (e.g., users' cultural background, age, gender).
    3. Individual differences in sensitivity to thermal stimuli led to inconsistent experiences among participants.
  • Future Directions:
    • Consider personalized calibration of tactile feedback to accommodate varying thermal sensitivities among users.
    • Explore the application of tactile signals in social interactions involving actual human users rather than agents.
    • Conduct comprehensive studies on other types of biosignals (e.g., skin conductance or real-time heart rate) in VR environments.
    • Further analyze the combined effects of multiple agents or groups on bodily perception and proxemics.

By exploring the application of tactile feedback technology in virtual agents, this study provides valuable theoretical foundations and design guidelines for creating lifelike social interactions in virtual reality, while also addressing related ethical and technical challenges.