EYEditor: Towards On-the-Go Heads-Up Text Editing Using Voice and Manual Input
Authors
On-the-go text-editing is difficult, yet frequently done in everyday lives. Using smartphones for editing text forces users into a heads-down posture which can be undesirable and unsafe. We present EYEditor, a heads-up smartglass-based solution that displays the text on a see-through peripheral display and allows text-editing with voice and manual input. The choices of output modality (visual and/or audio) and content presentation were made after a controlled experiment, which showed that sentence-by-sentence visual-only presentation is best for optimizing users' editing and path-navigation capabilities. A second experiment formally evaluated EYEditor against the standard smartphone-based solution for tasks with varied editing complexities and navigation difficulties. The results showed that EYEditor outperformed smartphones as either the path OR the task became more difficult. Yet, the advantage of EYEditor became less salient when both the editing and navigation was difficult. We discuss trade-offs and insights gained for future heads-up text-editing solutions.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 60%
The Impact of Word, Multiple Word, and Sentence Input on Virtual Keyboard Decoding Performance
CHI '18· Voice User Interface (VUI) Design +1
- 60%
Collecting and Characterizing Natural Language Utterances for Specifying Data Visualizations
CHI '21· Voice User Interface (VUI) Design +1
- 60%
PonDeFlick: A Japanese Text Entry on Smartwatch Commonalizing Flick Operation with Smartphone Interface
CHI '24· Foot & Wrist Interaction +1
- 60%
Content-Driven Local Response: Supporting Sentence-Level and Message-Level Mobile Email Replies With and Without AI
CHI '25· Voice User Interface (VUI) Design +1
- 60%
Stretch Gaze Targets Out: Experimenting with Target Sizes for Gaze-Enabled Interfaces on Mobile Devices
CHI '25· Eye Tracking & Gaze Interaction +1
- 60%
To Draw or Not to Draw: Stroke-Hover Intent Recognition in Bare-hand Mid-Air Curve Input
IUI '18· Head-Up Display (HUD) & Advanced Driver Assistance Systems (ADAS) +1
- 60%
Intelligently Recommending Key Bindings on Physical Keyboards with Demonstrations in Emacs
IUI '19· Voice User Interface (VUI) Design +1
- 60%
Vajra: Step-by-step programming with natural language
IUI '19· Voice User Interface (VUI) Design +1
- 60%
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations
IUI '25· Voice User Interface (VUI) Design +1
- 60%
Single-tap Latency Reduction with Single- or Double- tap Prediction
MobileHCI '23· Head-Up Display (HUD) & Advanced Driver Assistance Systems (ADAS) +1
Based on Jaccard similarity of research subtopics & professions (≥60%)