Designing Distinguishable Mid-Air Ultrasound Tactons with Temporal Parameters

Document Title

Designing Distinguishable Mid-Air Ultrasound Tactons with Temporal Parameters

Document Information

• Research Field: Human-Computer Interaction and Mid-Air Ultrasound Haptics
• Keywords: Mid-air haptics, ultrasound haptic design, tactile distinguishability, temporal parameters, parametric design, metaphorical design, experimental evaluation

Research Background and Problem

• Identified Issues or Challenges:
  • Although mid-air ultrasound haptics offer rich design opportunities for contactless tactile feedback, there are few established guidelines for designing tactile icons (Tactons) that are easily distinguishable by users.
  • Extensive research exists on tactile design using mechanical vibrations, but it is unclear whether these findings can be directly applied to the design of ultrasound Tactons.
• Research Importance:
  • Designing distinguishable tactile icons is crucial for information delivery and interaction in fields such as public displays, automotive user interfaces, and virtual reality.
• Motivation and Related Work:
  • The literature has proposed various temporal parameters for mechanical tactile design (e.g., rhythm, amplitude), but their effectiveness in ultrasound Tactons has not been thoroughly validated.
  • Differences in distinguishability between ultrasound and mechanical tactile feedback require further investigation to guide cross-technology design adaptation.

Solution

• Proposed Methods or Solutions:
  • The authors conducted five user studies to systematically investigate the impact of various temporal parameters on the distinguishability of ultrasound Tactons.
  • Parameters studied include: amplitude modulation frequency (AM frequency), rhythm, envelope frequency, overlap ratio, total duration, and their combinations.
  • A comparison of user perception spaces for ultrasound Tactons and mechanical tactile feedback under identical parameters.
• Innovations:
  • First-time provision of discrimination threshold (JND) data for ultrasound AM frequencies.
  • Comparison of perceptual similarities between ultrasound and mechanical tactile feedback under identical design parameters, validating the applicability of parameter transfer.
  • Detailed design guidelines for parametric and metaphorical design of ultrasound Tactons.
• Implementation Steps and Key Techniques:
  1. Study 1: Measuring discrimination thresholds (JND) for AM frequencies.
  2. Studies 2–5: Designing four sets of ultrasound Tactons and testing their distinguishability.
  3. Data analysis: Using multidimensional scaling (MDS) to construct and visualize the perceptual space of ultrasound Tactons, and comparing it with the perceptual space of mechanical vibrations.

Research Outcomes

• Specific Results:
  1. Discrimination Thresholds (JND):
     • Discrimination thresholds for AM frequencies of 30 Hz, 80 Hz, and 210 Hz were 47%, 77.4%, and 68.4%, respectively, showing significant differences across frequencies.
  2. Effectiveness of Temporal Parameters:
     • Low envelope frequencies (≤ 5 Hz) and rhythm structures (e.g., number and duration of pulses) were dominant perceptual parameters for ultrasound Tactons.
     • Key dimensions of rhythm space included pulse count and total duration, both contributing significantly to distinguishability.
  3. Correspondence Between Ultrasound and Mechanical Tactile Perception:
     • Across four experimental groups, perceptual similarities between ultrasound and mechanical Tactons showed Spearman’s correlation coefficients of 0.70, 0.61, 0.89, and 0.78, indicating strong correlations.
  4. Stability of Metaphorical Design:
     • Ultrasound Tactons with high-complexity waveforms (e.g., heartbeat and animal sounds in metaphorical designs) exhibited perceptual trends highly consistent with mechanical tactile designs.
• Advantages Compared to Existing Solutions:
  • Systematic design guidelines for ultrasound Tactons, covering both parametric and metaphorical design approaches.
  • Experiments encompassed multiple combinations of temporal parameters and provided quantitative thresholds (e.g., JND and correlation) for design use.
• Experimental or Evaluation Results:
  • Perceptual space data indicated that rhythm structures (especially pulse count and duration) had the most significant impact on distinguishability.
  • Low envelope frequencies and larger AM frequency scales were most sensitive to users’ tactile perception.
• Limitations and Future Directions:
  • Limitations:
    • Participant age range was narrow (18–46 years), potentially limiting generalizability to other age groups.
    • Perceptual intensity of temporal parameters was kept consistent with experimental intensity, but the potential impact of perceptual intensity matching was not explored.
  • Future Directions:
    • Further exploration of the interaction between perceptual intensity and temporal parameters in ultrasound haptics.
    • Development of automated design tools based on perceptual data to provide designers with more intuitive interfaces.
    • Extending research findings to more application-oriented 3D tactile shape designs.