Feellustrator: A Design Tool for Ultrasound Mid-Air Haptics

Title of the Paper

Feellustrator: A Design Tool for Ultrasound Mid-Air Haptics

Paper Information

• Domain: Human-Computer Interaction (HCI), Ultrasound Mid-Air Haptics Design Tools
• Keywords: Ultrasound technology, mid-air haptics design tools, tool requirements, interviews, virtual reality, perception studies, design prototyping, haptic design

Research Background and Problem

• Challenges:

  • Current ultrasound technology can efficiently generate tactile feedback at a 40kHz frequency in 3D space, but the process of programming tactile patterns is complex, hindering rapid iterative design.
  • There are numerous unknown design parameters, and the lack of specific quality metrics for haptic design increases design complexity.
  • Existing tools (e.g., Ultraleap's Sensation Editor) have limited customization capabilities and cannot support user-defined complex ultrasound haptic patterns.
  • Mid-air haptics technology lacks design standards and resources, requiring more trial and error compared to contact-based haptic design.

• Significance:

  • Ultrasound haptic technology can significantly enhance user experience and immersion in virtual and augmented reality.
  • Supporting faster haptic design iterations can accelerate research and application development in this field.
  • Providing systematic tools can lower technical barriers, enabling designers without programming experience to participate in haptic design.

• Motivation and Related Work:

  • Through interviews with 13 designers from diverse backgrounds and experiences, the authors identified numerous obstacles in current ultrasound design practices, including difficulties in understanding parameters, limitations of development tools, and unmet in-depth design needs.
  • The authors analyzed prior research and tools, including graphical design tools for contact-based haptics, but these tools cannot be directly applied to ultrasound design due to differences in parameter spaces.

Solution

• Proposed Method or Solution:

  • Feellustrator: A graphical design tool that supports ultrasound mid-air haptic design.
  • The tool enables rapid creation of haptic patterns, supports user-defined complex tactile effects, facilitates hand interaction testing, and allows export to other programs (e.g., Unity).

• Innovations:

  • Provides comprehensive parameter control (including time, space, and amplitude), supporting real-time interaction with 2D canvases and 3D users.
  • Features an intuitive graphical interface that is designer-friendly, reducing the design barrier.
  • Allows importing images and audio as references and provides visual previews without requiring hardware devices.
  • Adds support for layering and sequencing haptic patterns, enhancing design complexity and flexibility.

• Implementation Steps and Key Techniques:

  1. Defining Design Requirements: Collecting designer needs through interviews and summarizing tool requirements.
  2. Tool Development: Implementing functional modules, including canvas design, timeline control, parameter settings, and dynamic simulation.
  3. Example Scenarios: Creating three design examples (perception studies, data physicalization maps, virtual reality scenarios) to demonstrate the tool's capabilities.
  4. User Evaluation: Conducting user evaluations of the tool, including design outcomes and user feedback.

Research Outcomes

• Specific Outcomes:

  • Developed the Feellustrator tool, supporting designs ranging from simple graphics to complex multi-layer haptic effects.
  • Identified 11 key requirements for ultrasound haptic design tools and implemented these features in the tool.
  • Provided detailed design examples and user cases, showcasing how Feellustrator can be applied to psychophysical research, data interaction, and VR scene design.

• Advantages:

  • Feellustrator enables non-programmers to quickly engage in ultrasound haptic design while empowering experienced designers with greater artistic expression.
  • Significantly reduces the learning curve and technical barriers in the design process.
  • Supports multimodal design (sound, visual, haptic), facilitating creative design in multimedia interactions.

• Experimental or Evaluation Results:

  • Participants completed open-ended design tasks and iteratively optimized their designs within 30 minutes, demonstrating the tool's support for rapid prototyping.
  • Both lay users and professional designers highly praised the tool's intuitiveness and design freedom.
  • Professional users noted that the tool could inspire more innovation and has practical value for their future projects.

• Limitations and Future Directions:

  • The current tool only supports 2D design and its 3D projection, with limited support for full 3D volumetric design; future work could expand this functionality.
  • It does not fully support the simultaneous creation of multiple focal points in haptic pattern design, which could be enhanced in the future.
  • Hand tracking functionality and visual previews of simulated pressure fields could be further improved for greater precision.
  • Exploring algorithms for automatic generation of haptic patterns based on visual or voice input could further enhance the tool's convenience.
  • Developing algorithms to predict user perception could provide designers with more precise optimization suggestions for haptic patterns.

Conclusion

• Feellustrator supports ultrasound mid-air haptic technology by lowering design barriers and enhancing design capabilities.
• This research provides a reference framework for developing more advanced mid-air haptic design tools in the future and promotes the popularization and development of non-contact haptic design technologies.