DeltaPen: A Device with Integrated High-Precision Translation and Rotation Sensing on Passive Surfaces

Document Title

DeltaPen: A Device with Integrated High-Precision Translation and Rotation Sensing on Passive Surfaces

Document Information

• Field of Study: Human-Computer Interaction, Digital Stylus Devices, Gesture Interaction
• Keywords: Digital stylus, rotation sensing, tilt interaction, haptic feedback, high-precision input

Research Background and Problem

• Problem or Challenge:

  • Current digital stylus devices require specialized instrumented surfaces or external tracking systems to achieve high-precision operations, limiting mobility and usable surface range.
  • Existing "mouse stylus" devices severely restrict input operations, supporting only 2D translation, while lacking traditional mouse functionalities (e.g., input buttons), which affects naturalness and precision in operation.
  • There is a lack of compact digital stylus devices capable of simultaneously supporting rotation sensing, tilt interaction, and haptic feedback.

• Significance:

  • Enabling high-precision operations for digital stylus devices without external tracking can significantly expand their application range, especially in mobile environments and on non-instrumented surfaces.
  • Enhancing the functional dimensions of digital stylus devices (translation, rotation, pressure, haptic feedback) is crucial for professional applications (e.g., drawing, writing, UI manipulation).

• Research Motivation:

  • The authors aim to develop a fully functional digital stylus device by integrating all sensing and input components, thereby enabling new possibilities for mobile scenarios and large-surface operations.

• Related Work:

  • Previous studies have explored the use of external cameras or specialized surfaces to achieve high-precision stylus input, but these methods face limitations in mobility and flexibility.
  • Active haptic feedback technologies and visual tracking systems have demonstrated potential for improving stylus input performance but often rely on external devices.
  • Dual-sensor approaches are primarily applied to mouse devices rather than stylus-shaped devices, which require addressing new technical challenges in the compact pen-tip area.

Solution

• Method or Solution:

  • DeltaPen integrates two fast, compact lensless optical flow sensors, an inertial measurement unit (IMU), and a pressure sensor, enabling detection of 2D translation and rotation angles on non-instrumented surfaces.
  • Provides a processing pipeline for optical flow signal filtering and fusion, combined with tilt correction and magnetoresistive data for data optimization.
  • Haptic feedback is delivered via a linear resonant actuator to convey pressure and click effects.

• Innovations:

  • Achieves fully integrated high-precision translation and rotation detection capabilities without requiring specialized surfaces or cameras.
  • Utilizes optical flow sensors with a cleverly designed sensor layout at the pen tip to capture rotation angles in a compact space.
  • Successfully deploys the dual-sensor principle in a stylus-shaped device for precise motion separation along the rotational axis.
  • Integrates pressure sensors and a linear resonant actuator to provide haptic feedback functionality.

• Implementation Steps:

  1. Angle Calculation: Compute the stylus's rotation angle using data from two optical sensors and separate translation and rotation signals.
  2. DPI Correction: Correct raw optical flow data based on the angle between the sensors and the surface.
  3. Magnetoresistive Data Enhancement: Optimize rotation estimation by detecting frame-to-frame changes in magnetoresistive data.
  4. Pressure Sensing: Detect user-applied stylus pressure and output haptic feedback.
  5. Integration of User Interaction Features: Support applications such as drawing, dragging, rotating, etc.

Research Outcomes

• Specific Results:

  • Successfully developed the DeltaPen prototype device, achieving high-precision translation and rotation detection without requiring instrumented surfaces.
  • Technical evaluations show DeltaPen's angle estimation error ranges from 0.0095 to 0.0099 radians, closely matching external benchmarks.
  • Implemented user-facing interaction applications, including virtual drawing, interactive controls (buttons, sliders, knobs), and haptic feedback-based operations.

• Advantages Over Existing Solutions:

  • Compared to devices requiring surrounding camera tracking or specific surface support, DeltaPen is more lightweight and mobile-friendly.
  • Offers multiple input dimensions, including rotation, tilt interaction, and haptic feedback; more comprehensive than traditional "mouse stylus" or active stylus functionalities.
  • Directly integrates the processing pipeline within the stylus-shaped device, eliminating the need for external processing hardware.

• Experimental or Evaluation Results:

  • In technical evaluations, DeltaPen demonstrated minimal error in rotation detection compared to external tracking systems.
  • Users achieved high input precision when drawing complex shapes, while haptic feedback enhanced operational responsiveness.
  • The stylus device performed excellently in free movement across large surfaces, suitable for various indoor and mobile scenarios.

• Limitations and Future Directions:

  • The current device still relies on a USB interface for power and communication; future iterations should integrate wireless functionality and batteries for complete self-containment.
  • Initial rotation angle estimation requires manual calibration; exploring machine learning methods for calibration-free operation is a future goal.
  • Airborne interaction features are not fully developed; combining IMU and visual tracking to support continuous in-air actions will be explored.
  • Larger-scale user experiments are needed to validate DeltaPen's effectiveness and user acceptance in interaction scenarios.

Conclusion

DeltaPen is a fully functional digital stylus device that integrates all sensing components and provides high-precision translation and rotation detection capabilities, advancing digital stylus technology toward greater portability and broader applicability. Future work will focus on optimizing device design and user experience while exploring richer interaction scenarios.