TypeBoard: Identifying Unintentional Touch on Pressure-Sensitive Touchscreen Keyboards
Authors
In-Vehicle Haptic, Audio & Multimodal FeedbackVibrotactile Feedback & Skin StimulationSoftware Engineers & DevelopersUI/UX Designers
Document Title
TypeBoard: Identifying Unintentional Touch on Pressure-Sensitive Touchscreen Keyboards
Document Information
- Field of Study: Human-Computer Interaction, focusing on unintentional touch detection and user input efficiency improvement for smart touch devices
- Keywords: unintentional touch detection, pressure-sensitive screens, touchscreen keyboards, user efficiency, unintended touch, user behavior, touch input, interactive devices
Research Background and Problem Statement
- Identified Problems:
- Traditional touchscreen keyboards face issues with misrecognizing unintended touches, such as accidental inputs caused by fingers resting on the screen, which negatively impact input efficiency and user experience.
- On tablet devices, users cannot naturally rest their fingers as they would on physical keyboards to reduce fatigue, and they need to constantly shift visual attention, further decreasing input speed and accuracy.
- Significance:
- Unintentional touch not only disrupts user workflows but also leads to fatigue and reduced efficiency, limiting the applicability of touchscreen keyboards in tasks requiring high-speed and accurate text input.
- Enhancing touchscreen keyboard performance can help narrow the gap between touchscreen and physical keyboards in terms of user experience and efficiency.
- Research Motivation and Related Work:
- Previous studies, such as TapBoard, have made progress in unintentional touch detection but have limitations in accuracy (e.g., 97%) and usability.
- The growing adoption of pressure-sensitive technology provides new hardware support to address these challenges.
- This paper sets out three key research questions (RQ): (1) How do users perform on an "anti-unintentional touch keyboard"? (2) How can TypeBoard be designed based on user behavior? (3) What is the actual performance of TypeBoard?
Solution
- Proposed Solution:
- This paper introduces TypeBoard, a pressure-sensitive touchscreen keyboard capable of accurately detecting and preventing misrecognition caused by unintended touches.
- Additionally, TypeBoard Plus integrates tactile feedback (e.g., haptic markers on specific keys) to support touch typing (non-visual input guided by tactile cues).
- Innovations:
- Utilizes a machine learning (SVM) model to analyze and classify touch behavior, achieving a high detection accuracy of 98.88% with a latency as low as 100ms.
- Iteratively optimizes input behavior modeling and unintentional touch filtering algorithms.
- Incorporates tactile markers into TypeBoard, achieving the first implementation of tactile-assisted input on touchscreen keyboards.
- Implementation Steps:
- Data Collection and Initial Model Development:
- Collect user input behavior data on a pressure-sensitive touchpad without feedback and design an initial model (preliminary implementation of unintentional touch detection).
- Iterative User Behavior Study:
- Design TypeBoard using the initial model and observe actual user behavior, refining the final model based on new behavior data.
- System Evaluation:
- Compare the performance of TypeBoard and TypeBoard Plus against standard touchscreen keyboards in terms of input speed, accuracy, and user experience.
- Data Collection and Initial Model Development:
Research Outcomes
- Specific Results:
- TypeBoard achieves an unintentional touch detection accuracy of 98.88%, with only 0.93 misclassifications per 100 key presses.
- Users can naturally rest their fingers on the device without triggering erroneous inputs, significantly reducing fatigue.
- Compared to standard touchscreen keyboards, input speed increased by 11.78%; TypeBoard Plus, with tactile markers, further improved speed by 8.5%, achieving an overall improvement of 21.19%.
- Advantages Over Existing Solutions:
- Superior detection performance compared to TapBoard (TypeBoard accuracy 98.88% vs. TapBoard ~97%).
- Provides a natural input method without requiring changes to user behavior.
- Highly versatile, applicable to future touchscreen devices equipped with pressure-sensitive capabilities.
- Experimental or Evaluation Results:
- TypeBoard's reliability and efficiency were tested across various task scenarios.
- Experiments showed that users performed more accurately on TypeBoard Plus, with shorter pause times, leveraging tactile markers for quick key localization.
- Limitations and Future Directions:
- Deep learning algorithms were not fully explored in this study; future work could further optimize detection performance using deep learning.
- Validation and adaptation across more languages and input methods are needed, such as studying text input behavior beyond English.
- For scenarios where resting fingers cannot directly trigger key presses, implementation strategies or additional tactile feedback technologies need optimization.
Additional Summary and Discussion
- Why Deep Learning Was Not Used:
- Deep learning requires significant computational resources, which conflicts with the real-time requirements of touchscreen keyboards.
- Superiority of Iterative Methods:
- The iterative process provides a more realistic understanding of user behavior, effectively addressing the "inducement loop" between technology and user behavior.
- Exploration of Future Possibilities:
- Keyboard layouts and language models could be integrated to further optimize unintentional touch detection.
- Research could explore hardware solutions beyond pressure-sensitive devices, such as combining tactile vibration feedback and surface deformation technologies.
Research Questions / Practical Problems
Question signals indexed for this paper.
help
Research Questions
3- How do users perform on preventing accidental touch keyboard input?Category: Input Recognition, Touch Modeling, and Interaction Decoding MethodsSimilar questionsarrow_forward
- How can TypeBoard (an accidental-touch-preventing pressure-sensing keyboard) be designed based on user behavior?Category: Input Recognition, Touch Modeling, and Interaction Decoding MethodsSimilar questionsarrow_forward
- What is the actual performance of TypeBoard?Category: Input Recognition, Touch Modeling, and Interaction Decoding MethodsSimilar questionsarrow_forward
lightbulb
Practical Problems
1- Touchscreen keyboards misrecognize unintentional touches, affecting input efficiency and UX.Category: Input Recognition, Touch Modeling, and Interaction Decoding MethodsSimilar questionsarrow_forward
- 67%
Multilayer Haptic Feedback for Pen-Based Tablet Interaction
CHI '19· In-Vehicle Haptic, Audio & Multimodal Feedback +2
- 60%
Magnetips: Combining Fingertip Tracking and Haptic Feedback for Around-Device Interaction
CHI '19· In-Vehicle Haptic, Audio & Multimodal Feedback +1
- 60%
WATouCH: Enabling Direct Input on Non-touchscreen Using Smartwatch's Photoplethysmogram and IMU Sensor Fusion
CHI '20· In-Vehicle Haptic, Audio & Multimodal Feedback +1
- 60%
Eyes-Off Your fingers: Gradual Surface Haptic Feedback Improves Eyes-Free Touchscreen Interaction.
CHI '22· In-Vehicle Haptic, Audio & Multimodal Feedback +1
- 60%
Haptics with Input: Back-EMF in Linear Resonant Actuators to Enable Touch, Pressure and Environmental Awareness
UIST '20· In-Vehicle Haptic, Audio & Multimodal Feedback +1
Based on Jaccard similarity of research subtopics & professions (≥60%)
Quick Actions
AdRecommended
Learn AI Coding at CodeNow
open_in_newOpen DOI Link
DOI: https://doi.org/10.1145/3472749.3474770
At a Glance
fact_checkPaper Snapshot
dataset
Source
UIST
calendar_month
Year
2021
emoji_events
Award
No award tagged
group
Authors
5 authors
sell
Subtopics
In-Vehicle Haptic, Audio & Multimodal Feedback, Vibrotactile Feedback & Skin Stimulation
work
Professions
Software Engineers & Developers, UI/UX Designers
article
Content Status
Full text indexed
hub
Related Papers
5 related papers