Attracting Fingers with Waves: Potential Fields Using Active Lateral Forces Enhance Touch Interactions

Research Background and Problem

• Identified Problem: Touchscreens and touchpads are highly intuitive for interface interaction but lack the tactile feedback of physical buttons. Existing tactile feedback typically relies on mechanical vibrations, which fail to provide continuous directional guidance for users' fingers. This forces users to rely on visual input, creating challenges for visually impaired individuals and tasks requiring sustained situational awareness, such as driving or flying.
• Significance: Tactile feedback can significantly reduce users' reliance on vision, enhancing interaction capabilities under non-visual conditions and contributing to improved user experience and operational safety.
• Research Motivation and Related Work:
  • Surface tactile devices can alter friction through ultrasonic traveling waves or electrostatic adhesion, offering potential improvements in user interaction efficiency. However, these technologies only provide reactive feedback to sliding fingers, failing to effectively guide stationary fingers or deliver clear directional cues.
  • Previous studies have demonstrated that active lateral forces can provide directional guidance to fingers, but these investigations have primarily focused on simple force generation validation, lacking extensive user-level testing and exploration of complex designs.

Solution

• Proposed Method:
  • Develop an ultrasonic-driven lateral force feedback touch device (Ultraloop) that leverages a tactile modality based on artificial potential fields. By adjusting the phase and amplitude of traveling waves, elastic potential fields are rendered in real-time to provide attractive and repulsive forces to users' fingers.
  • Utilize negative gradient modeling: map the negative gradient of target topology into tactile forces, making the perceived surface "undulate," thereby achieving diverse tactile effects such as protrusions, depressions, and attractive grooves.
• Innovations:
  • Introduce the classical concept of artificial potential fields into touch interaction, actively controlling lateral forces to validate users' tactile recognition and navigation performance in both sliding and stationary states for the first time.
  • Compare active forces with traditional friction modulation techniques, demonstrating that active forces can overcome directional constraints of conventional technologies and significantly enhance perception and performance.
• Implementation Steps and Key Technologies:
  1. Design and implement an active force touch device based on ultrasonic traveling waves capable of generating specific attractive/repulsive force fields on a flat touchscreen.
  2. Propose methods for real-time calculation of fingertip position and applied force direction, including the use of position sensors, phase modulation, and impedance control.
  3. Conduct three user studies to validate effects on shape perception, point selection performance, and directional navigation.

Research Outcomes

• Specific Results:
  1. Confirmed that users can accurately perceive and distinguish "protrusions" and "depressions" rendered by Gaussian potential fields, with a detection threshold of 30 mN.
  2. Proposed a more effective target selection method, achieving a 22.9% improvement in target localization speed compared to friction modulation methods in high-friction areas surrounded by attractive forces.
  3. Enabled directional navigation for static user positions, using active lateral forces to guide finger direction, with accuracy significantly outperforming friction modulation techniques (12% error rate vs. 51%).
• Advantages Over Existing Solutions:
  • Active force feedback can apply guiding forces to stationary fingers or in non-inertial directions, whereas friction modulation devices only function during finger sliding.
  • Provides higher localization accuracy and user confidence in small-area or complex navigation tasks.
  • Enhanced functional extensibility, capable of simulating complex physical effects (e.g., slingshot stretching, path attraction) and applicable to more challenging tactile interface designs.
• Experimental and Evaluation Results:
  • User experience studies conducted across various scenarios (e.g., virtual keyboard, "Angry Birds," password lock) revealed significant improvements in users' operational focus, reduced visual burden, confidence, and enjoyment.
  • Potential applications include non-visual control, virtual interface interaction, and educational feedback devices.
• Limitations and Future Directions:
  • The current force generation model uses feedforward control, without accounting for variations in sliding speed and finger pressure, potentially leading to inconsistent force output across users.
  • Experiments were primarily conducted in one-dimensional space, without extending to two-dimensional omnidirectional tactile force generation and application.
  • Future work should explore closed-loop control, more complex potential field designs, and broader interaction scenarios (e.g., non-visual curve guidance or tactile grid rendering).

This study highlights the potential of active lateral forces in touch interaction, paving the way for advanced tactile interface design and application. It also demonstrates, for the first time, the comprehensive capability of artificial potential fields in delivering tactile guidance.