FlexiVol: a Volumetric Display with an Elastic Diffuser to Enable Reach-Through Interaction

Research Background and Problem

• Identified Problems or Challenges: Traditional volumetric displays can present true 3D images, providing multiple visual cues, including depth perception. However, these devices typically require rigid diffusers, preventing users from directly interacting with virtual objects inside. Additionally, these systems rely on indirect interaction methods, such as a mouse or keyboard, lacking natural interaction modalities.
• Significance: Enabling direct interaction with 3D graphics can enhance user intuitiveness and immersion, potentially expanding the applications of volumetric displays in fields such as gaming, medicine, and 3D modeling.
• Research Motivation and Related Work: While previous studies have explored 2D/2.5D technologies, such as fog screen projection and manipulation through intermediary mediums, no mature methods have addressed how to support hand penetration through 3D display volumes while maintaining visual accuracy. The authors propose introducing an elastic diffuser to achieve this innovation.

Solution

• Proposed Method or Solution: A novel "elastic diffuser volumetric display" called FlexiVol is introduced. It replaces traditional rigid diffusers with deformable elastic diffusers, allowing users to insert their hands into the display volume for direct interaction with 3D virtual objects.
• Innovations:
  • Replacing rigid diffusers with elastic diffusers to enable hand penetration.
  • Introducing distortion correction methods to compensate for 3D image deformation caused by diffuser vibrations.
  • Developing a design space to support various direct interaction gestures and actions for manipulating 3D objects.
• Implementation Steps and Key Techniques:
  1. Hardware Design: Modify an existing volumetric display device (Voxon VX1) and build a custom display using elastic bands to achieve high-frequency vibrations of the diffuser.
  2. Material Selection and Testing: Analyze various elastic materials, including elastic bands, silicone, and fabrics, for their optical diffusion properties, stiffness, frequency response, and durability. Elastic bands were ultimately selected as the optimal material.
  3. Distortion Correction: Use a high-frame-rate camera to record the diffuser's vibration behavior and establish a parabolic model to calibrate 3D image deformation caused by the elastic diffuser.
  4. User Gesture Design: Plan interaction techniques based on gestures and actions, such as grabbing, rotating, and scaling, to align with intuitive real-world operation patterns.

Research Outcomes

• Specific Results:
  • In three user tasks (selection, tracing, docking), FlexiVol's direct interaction demonstrated faster completion times compared to traditional 3D mouse input.
  • Provided design guidelines for optimizing the physical and optical properties of the novel elastic diffuser material.
  • Achieved dynamic image distortion calibration, enabling the use of elastic diffusers without visual distortion.
• Advantages Compared to Existing Methods:
  • Compared to existing volumetric display technologies, FlexiVol enables safe hand penetration while providing true 3D images, overcoming safety issues and operational limitations of rigid diffusers.
  • Compared to traditional 3D mice, tactile feedback and gesture naturalness significantly enhance the user experience.
• Experimental or Evaluation Results:
  • Tests showed that direct interaction achieved significantly faster completion times in selection and docking tasks (1.0 seconds and 3.9 seconds) compared to using a 3D mouse (1.9 seconds and 4.6 seconds).
  • NASA-TLX survey results indicated that FlexiVol outperformed the 3D mouse mode in cognitive load, time pressure, and overall effectiveness.
  • In terms of precision, FlexiVol performed slightly worse than the 3D mouse (center alignment accuracy error of 22mm vs. 18mm).
• Limitations and Future Directions:
  1. Limitations:
     • Long-term deformation and wear of the elastic diffuser have not been fully tested.
     • The current hand-tracking method affects accuracy and requires improvement.
     • The current display volume and resolution are limited and need enhancement for more complex applications.
  2. Future Directions:
     • Develop larger rotating diffusers to increase display volume.
     • Add real-time rendering correction mechanisms to address image distortion caused by user hand contact.
     • Integrate haptic technologies (e.g., ultrasound or electrical stimulation) to enhance tactile realism during interaction.
     • Explore collaborative applications, such as multi-user simultaneous operations and more complex cooperative task scenarios.

Conclusion

FlexiVol innovatively enhances the interaction experience of volumetric displays through the use of elastic diffusers, demonstrating its potential applications in areas such as virtual pets, 3D modeling, and gaming. User studies validated its intuitiveness and user-friendliness. Future development will focus on improving hardware performance and developing more complex interaction techniques.