FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined Spaces

Title of the Paper

FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined Spaces

Paper Information

• Domain: Virtual Reality and Human-Computer Interaction
• Keywords: FingerMapper, VR interaction, virtual reality, confined spaces, body remapping
• Publication Date and Conference: April 2023, CHI ’23 Conference

Research Background and Problem

• Identified Problem or Challenge: Current virtual reality (VR) interactions often require full-body movements to enhance immersion. However, performing full-body movements in confined spaces (e.g., inside public transportation) is impractical, potentially causing physical fatigue and collisions with the surrounding environment.
• Importance of the Problem: As VR devices become increasingly mobile (e.g., Oculus Quest), enabling their use in more environments, it is critical to address the limitations of movement space and ensure user safety in confined spaces.
• Motivation and Related Work: Although previous research has explored methods to reduce physical fatigue or movement path length, these techniques often require larger physical spaces and are unsuitable for confined scenarios. The concept of "supernatural" interaction has introduced the possibility of mapping user movements to larger virtual actions.

Solution

• Proposed Method or Solution: The authors developed FingerMapper, a system that maps small-scale finger movements onto virtual arms and hands to support VR interaction in confined spaces.
• Innovations:
  1. Mapping finger movements to larger virtual actions, enabling users to perform simulated full-body interactions with minimal physical movement in limited spaces.
  2. Two mapping methods—Attach and Direct—based on finger position projection mapping and body re-association concepts, respectively.
  3. Introduction of spatial extension techniques to dynamically adjust the length of virtual arms, enhancing user control.
  4. Three application examples (FingerGrabber, FingerSaber, FingerClimber) tailored for different interaction scenarios.
• Implementation Steps and Key Techniques:
  1. Design of two mapping methods: Attach calculates paths through finger extension projection, while Direct re-associates actions based on joint postures.
  2. Integration of the Go-Go Technique to enhance spatial extension of arm movements.
  3. Adaptation for Oculus Quest’s hand-tracking system to enable real-time response with FingerMapper.

Research Outcomes

• Specific Results:
  1. Experiments demonstrated that FingerMapper effectively reduces physical movement and user fatigue while maintaining a similar level of accuracy.
  2. Tests in confined spaces (e.g., car seats) showed that FingerMapper significantly reduced collisions with the environment, enhancing users' sense of safety.
  3. The three example applications showcased the usability of FingerMapper in various interaction scenarios.
• Advantages:
  • Compared to hand tracking, FingerMapper reduces movement and collisions while positively impacting user safety perception.
  • Although slightly slower than ray projection in task completion time, FingerMapper offers better object manipulation capabilities and a stronger sense of body ownership.
• Experimental or Evaluation Results:
  • Study 1: In a target selection task, FingerMapper significantly reduced physical space interaction (approximately 67.8% of hand tracking) while maintaining high levels of user immersion and presence.
  • Study 2: Tests in a car passenger seat environment showed that FingerMapper significantly reduced collisions, with users reporting higher safety and preference ratings.
• Limitations and Future Directions:
  1. The virtual arm displacement introduced by mapping resulted in lower virtual body ownership (VBO). Future improvements could incorporate haptic feedback to address this issue.
  2. The current study focused on controlled experimental environments; future research could explore its applicability and social impact in public settings.
  3. The current mapping primarily supports basic functions; future work could optimize mappings for more complex actions.

Conclusion

FingerMapper provides an innovative approach to addressing the challenge of full-body movement in confined spaces by mapping small-scale finger motions onto virtual arms. The system significantly enhances user safety and experience while reducing physical fatigue. This technology is well-suited for confined-space scenarios requiring virtual interaction and holds broad potential for practical applications.