The Impact of Word, Multiple Word, and Sentence Input on Virtual Keyboard Decoding Performance
Authors
Entering text on non-desktop computing devices is often done via an onscreen virtual keyboard. Input on such keyboards normally consists of a sequence of noisy tap events that specify some amount of text, most commonly a single word. But is single word-at-a-time entry the best choice? This paper compares user performance and recognition accuracy of word-at-a-time, phrase-at-a-time, and sentence-at-a-time text entry on a smartwatch keyboard. We evaluate the impact of differing amounts of input in both text copy and free composition tasks. We found providing input of an entire sentence significantly improved entry rates from 26 wpm to 32 wpm while keeping character error rates below 4%. In offline experiments with more processing power and memory, sentence input was recognized with a much lower 2.0% error rate. Our findings suggest virtual keyboards can enhance performance by encouraging users to provide more input per recognition event.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 60%
WATouCH: Enabling Direct Input on Non-touchscreen Using Smartwatch's Photoplethysmogram and IMU Sensor Fusion
CHI '20· In-Vehicle Haptic, Audio & Multimodal Feedback +1
- 60%
EYEditor: Towards On-the-Go Heads-Up Text Editing Using Voice and Manual Input
CHI '20· Head-Up Display (HUD) & Advanced Driver Assistance Systems (ADAS) +1
- 60%
Collecting and Characterizing Natural Language Utterances for Specifying Data Visualizations
CHI '21· Voice User Interface (VUI) Design +1
- 60%
PonDeFlick: A Japanese Text Entry on Smartwatch Commonalizing Flick Operation with Smartphone Interface
CHI '24· Foot & Wrist Interaction +1
- 60%
Content-Driven Local Response: Supporting Sentence-Level and Message-Level Mobile Email Replies With and Without AI
CHI '25· Voice User Interface (VUI) Design +1
- 60%
Stretch Gaze Targets Out: Experimenting with Target Sizes for Gaze-Enabled Interfaces on Mobile Devices
CHI '25· Eye Tracking & Gaze Interaction +1
- 60%
Intelligently Recommending Key Bindings on Physical Keyboards with Demonstrations in Emacs
IUI '19· Voice User Interface (VUI) Design +1
- 60%
Vajra: Step-by-step programming with natural language
IUI '19· Voice User Interface (VUI) Design +1
- 60%
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations
IUI '25· Voice User Interface (VUI) Design +1
- 60%
Voicify Your UI: Towards Android App Control with Voice Commands
UbiComp '23· Voice User Interface (VUI) Design +1
Based on Jaccard similarity of research subtopics & professions (≥60%)