AdapTics: A Toolkit for Creative Design and Integration of Real-Time Adaptive Mid-Air Ultrasound Tactons

Title of the Paper

AdapTics: A Toolkit for Creative Design and Integration of Real-Time Adaptive Mid-Air Ultrasound Tactons

Paper Information

• Subject Area: Human-Computer Interaction (HCI), Applications and Design Tools for Ultrasound Haptic Technology
• Keywords: Haptic Design, Design Tools, Mid-Air Ultrasound Haptics, Tacton, Real-Time Adaptation

Research Background and Problem

• Identified Problem or Challenge: Current mid-air ultrasound haptic design tools primarily support static, unchangeable tactile icons (tactons), lacking the expressive and dynamic adjustment capabilities required in interactive scenarios that demand real-time responses. Additionally, these tools impose high technical demands on designers, limiting rapid prototyping and exploratory creative design.
• Significance: Achieving real-time adaptive haptic design is a critical direction for the development of mid-air haptic technology, particularly in augmented reality (XR) applications, where it can significantly enhance user interaction experiences and immersion.
• Motivation and Related Work: Inspired by adaptive audio design, researchers aim to explore the design space of adaptive haptics and develop tools to support rapid prototyping for designers. Related tools such as Feellustrator have made progress in non-adaptive haptic design but cannot support the creation and real-time rendering of dynamic adaptive haptics.

Solution

• Method or Solution:

  1. Propose the AdapTics toolkit, which includes a graphical design tool (AdapTics Designer) and a real-time rendering engine (AdapTics Engine) to support the design and integration of adaptive mid-air ultrasound haptics.
  2. Define a five-dimensional design space for adaptive haptic design (Adaptation Granularity, Timing, Spatial Configuration, Feel, Type of Transformation) to provide structured guidance for designers.
  3. Offer an open-source real-time rendering tool that enables rapid prototyping and seamless integration into XR applications.

• Innovations:

  1. Introduce real-time adaptive haptic design capabilities, allowing haptic feedback to dynamically respond to user interactions, environmental changes, and other external inputs.
  2. Provide a structured framework for haptic design through the defined design space.
  3. Develop a high-performance rendering engine to support low-latency and high-frequency updates.

• Implementation Steps and Techniques:

  • Graphical Design: Designers use the visual interface of AdapTics Designer to create haptic patterns and directly adjust tactile parameters or link them to external variables.
  • Rendering and Integration: The AdapTics Engine renders haptic patterns and integrates them into XR scenarios, such as games or navigation applications, via its API and Unity wrapper.
  • User Testing and Iteration: Utilize the 3D simulation environment within the tool to test designs in real-time and adjust tactile properties based on external parameters.

Research Outcomes

• Specific Outcomes: Developed the AdapTics toolkit, supporting two types of haptic design tasks (non-adaptive and adaptive haptics), and demonstrated its effectiveness in creative support metrics through user evaluations. Specific results include:

  • Significant improvement in exploratory (Exploration) and expressive (Expressiveness) design capabilities.
  • Simplified complex haptic design through features like conditional branching and external variable mapping.

• Comparison with Existing Solutions: Compared to non-adaptive haptic design tools, AdapTics' adaptive features provide highly intelligent design capabilities for dynamic real-time feedback, significantly expanding the expressive and interactive potential of haptics.

• Experimental or Evaluation Results:

  • In a user study, 12 participants with experience in haptics or XR design used the AdapTics tool for design tasks.
  • Evaluated using the Creativity Support Index (CSI), the adaptive version of the tool scored significantly higher in exploration and expressiveness compared to the non-adaptive version.
  • Qualitative analysis revealed that designers appreciated the intuitive interface and the tool's potential for supporting dynamic haptic design.

• Limitations and Future Directions:

  • Limitations:
    1. High learning curve for the design tool, especially for beginners using adaptive features.
    2. Limited debugging and visualization capabilities, which may not fully meet advanced designer needs.
    3. The tool currently focuses on mid-air ultrasound haptics and does not support other haptic technologies, such as vibration feedback.
  • Future Directions:
    1. Develop more intuitive debugging and visualization features, such as 2D curve editing or enhanced 3D interactive environments.
    2. Expand support to other haptic technologies, such as mechanical vibration or force feedback.
    3. Integrate haptic design tools with adaptive audio tools for synchronized multisensory design in XR applications.

Conclusion

As the first open tool supporting adaptive mid-air haptic design, AdapTics addresses gaps in existing design tools. Its flexible design space and high-performance rendering engine provide designers with creative freedom. This study highlights the broad application potential of adaptive haptic technology in VR/AR and game design, with future research expected to further advance and optimize this field.