ArmDeformation: Inducing the Sensation of Arm Deformation in Virtual Reality Using Skin-Stretching

Title of the Paper

ArmDeformation: Inducing the Sensation of Arm Deformation in Virtual Reality Using Skin-Stretching

Paper Information

• Research Area: Virtual Reality (VR), Haptic Feedback, Body Ownership, and Illusions
• Keywords: Body Ownership, Body Illusion, Skin Stretching, Virtual Reality, User Immersion, Multisensory Feedback, Arm Deformation, Haptic Devices, User Experience, Visual-Haptic Integration

Research Background and Problem Statement

• Identified Issues or Challenges:

  • In virtual reality, when there are discrepancies between the shape of virtual avatars and users' real bodies (e.g., experiencing impossible body deformations through "rubber man" superpowers), users find it difficult to genuinely embody these avatars.
  • The human forearm has a limited range of rotation, making it challenging to represent large-angle forearm bending.
  • How to enhance users' sense of ownership over virtual bodies (avatars) and improve immersion through haptic feedback remains a key challenge.

• Significance of the Research:

  • Enhancing the experience of body ownership in virtual reality can improve virtual experiences in fields such as education, healthcare, and engineering design.
  • The integration of haptic and visual feedback can enhance user immersion, supporting future VR interaction designs and applications.

• Motivation and Related Work:

  • Visual feedback can induce body ownership by manipulating the shape of virtual avatars, but there are still challenges in adapting to unrealistic body shapes.
  • Studies have shown that multisensory integration can enhance body ownership, and haptic feedback (e.g., skin-stretching techniques) has been proven effective in improving body ownership.
  • Existing research primarily focuses on changes in body length (e.g., forearm elongation) or overall size, with limited exploration of nonlinear bending.

Proposed Solution

• Proposed Solution:

  • This paper introduces a wearable haptic device called "ArmDeformation," which uses skin-stretching technology to create illusions of arm length adjustment (elongation and shortening) and arm bending, enhancing users' sense of ownership over virtual bodies in virtual environments.
  • The device combines two types of feedback: visual feedback and skin-stretching haptic feedback.

• Innovations:

  • Demonstrated through experiments that two skin-stretching actuators are sufficient to effectively simulate arm length adjustments while avoiding additional device weight.
  • Expanded research on the perception of forearm bending direction, verifying users' visual and haptic thresholds for bending angles (approximately 50°).
  • Proposed four potential application scenarios (boxing, tentacle control, baseball catching, remote clicking) to showcase the potential of body deformation technology in VR interaction.

• Implementation Steps and Key Technologies:

  1. Redesigned the hardware for skin-stretching haptic feedback, including an adjustable rotation subsystem, an auto-adjustment subsystem, and a tactile stretching subsystem.
  2. Conducted five user experiments to optimize device design and functionality, validating the effectiveness of the feedback:
     • Experiment 1: Investigated the impact of the number of actuators on the illusion of arm adjustment.
     • Experiment 2: Explored the optimal skin-stretching design for the illusion of arm bending.
     • Experiment 3: Measured the maximum bending angle threshold for maintaining body ownership.
     • Experiment 4: Tested users' minimum perceptible differences in bending direction.
     • Experiment 5: Evaluated users' subjective experiences of realism and enjoyment in application scenarios.

Research Outcomes

• Specific Outcomes:

  • Confirmed that two skin-stretching actuators are sufficient to create the illusion of arm length adjustment, significantly outperforming visual feedback alone.
  • Designed and tested an arm-bending illusion based on two synchronized actuators, enhancing body ownership.
  • Identified the visual perception angle range for forearm bending (ownership begins to decline beyond approximately 50°).
  • Investigated the minimum perceptible difference in bending direction (5.64° to 27.97°), providing a reference for optimizing device latency in practical applications.
  • In terms of user experience, the combination of visual and haptic feedback significantly improved users' subjective evaluations of realism and enjoyment in virtual scenarios.

• Advantages Over Existing Solutions:

  • Compared to other studies, this device not only optimizes the number and configuration of actuators to reduce device weight but also introduces innovative haptic feedback for arm bending.
  • Quantitatively analyzed angle thresholds under visual and haptic feedback, providing actionable design parameters.

• Experimental or Evaluation Results:

  • Skin-stretching feedback significantly enhanced users' sense of body ownership and immersion compared to visual feedback alone (p<0.05).
  • Users reported high satisfaction with the device, particularly in the boxing and tentacle control scenarios, describing it as "highly realistic" and "fun."

• Limitations and Future Directions:

  • The device is relatively heavy, which could be optimized through lightweight designs (e.g., using carbon fiber materials).
  • The skin-stretching area is limited, and the impact of multi-point haptic feedback on arm deformation has not been fully explored.
  • Research on bending direction perception is focused on specific planes; future work will expand to other directions and more interaction forms.
  • The experimental scope needs to be broadened to cover more user scenarios and adopt more natural gesture controls and mapping methods.