Typing Haptically: Towards Enabling Non-auditory Smartphone Text Entry with Haptic Feedback for Blind and Low Vision Users
Authors
Text entry on smartphones remains challenging for Blind and Low Vision (BLV) users, particularly in environments where audio feedback is impractical due to noise, privacy, or social stigma. We present TypeHap, a new system that enables BLV users to type confidently on smartphones using only haptic feedback without relying on audio. Through formative interviews (N=20), we identified the key user needs and iteratively designed a compact, attachable system combining phoneme-based haptic cues delivered through piezo actuators embedded on both sides of the smartphone and a tactile overlay on a touchscreen for differentiating rows in a keyboard. In a four-day study (N=11), BLV participants trained with TypeHap achieved text entry speeds and accuracies comparable to typing with conventional audio feedback. Participants described TypeHap as liberating in public, noisy, and private contexts where audio feedback falls short. Our findings highlight haptic feedback as a promising alternative to audio-based interaction for enabling more private, accessible smartphone use of BLV users in diverse everyday contexts.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
Designing Unobtrusive Modulated Electrotactile Feedback on Fingertip Edge to Assist Blind and Low Vision (BLV) People in Comprehending Charts
CHI '24· Vibrotactile Feedback & Skin Stimulation +1
- 80%
2Across: A Comparison of Audio-Tactile and Screen-Reader based Representations of a Crossword Puzzle
CHI '20· In-Vehicle Haptic, Audio & Multimodal Feedback +2
- 80%
ReCog: Supporting Blind People in Recognizing Personal Objects
CHI '20· Vibrotactile Feedback & Skin Stimulation +2
- 80%
Virtual Worlds Beyond Sight: Designing and Evaluating an Audio-Haptic System for Non-Visual VR Exploration
CHI '25· Vibrotactile Feedback & Skin Stimulation +2
- 80%
HaptiRead: Reading Braille as Mid-Air Haptic Information
DIS '20· Mid-Air Haptics (Ultrasonic) +2
- 80%
Wheeler: A Three-Wheeled Input Device for Usable, Efficient, and Versatile Non-Visual Interaction
UIST '24· Vibrotactile Feedback & Skin Stimulation +2
- 75%
A Face Recognition Application for People with Visual Impairments: Understanding Use Beyond the Lab
CHI '18· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 75%
Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation
CHI '18· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 75%
SteeringWheel: A Locality-Preserving Magnification Interface for Low Vision Web Browsing
CHI '18· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
- 75%
Caption Crawler: Enabling Reusable Alternative Text Descriptions using Reverse Image Search
CHI '18· Visual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)
Based on Jaccard similarity of research subtopics & professions (≥60%)