Type, Then Correct: Intelligent Text Correction Techniques for Mobile Text Entry Using Neural Networks
Authors
Current text correction processes on mobile touch devices are laborious: users either extensively use backspace, or navigate the cursor to the error position, make a correction, and navigate back, usually by employing multiple taps or drags over small targets. In this paper, we present three novel text correction techniques to improve the efficiency of the correction process: Drag-n-Drop, Drag-n-Throw, and Magic Key. All of the techniques skip error-deletion and cursor-positioning procedures, and instead allow the user to type the correction first, and then apply that correction to a previously committed error. Specifically, Drag-n-Drop allows a user to drag a correction and drop it on the error position. Drag-n-Throw lets a user drag a correction from the keyboard suggestion list and “throw” it to the approximate area of the error text. Our deep learning algorithm determines the most likely error in the targeted area and applies the correction. Magic Key allows a user to type a correction and tap a designated key to highlight possible error candidates. The user can navigate among these candidates by dragging atop the key, and can apply a correction by tapping the key. We evaluated these techniques in both text correction and transcription tasks. Our experiment results show that correction with the new techniques was significantly faster than de facto cursor and backspace-based correction. Our techniques apply to any touch-based text entry method.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 80%
Do It For Me vs. Do It With Me: Investigating User Perceptions of Different Paradigms of Automation in Copilots for Feature-Rich Software
CHI '25· Human-LLM Collaboration +1
- 80%
From Operation to Cognition: Automatic Modeling Cognitive Dependencies from User Demonstrations for GUI Task Automation
CHI '25· Human-LLM Collaboration +1
- 67%
Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation
CHI '24· Human-LLM Collaboration +1
- 67%
"If the Machine Is As Good As Me, Then What Use Am I?" – How the Use of ChatGPT Changes Young Professionals' Perception of Productivity and Accomplishment
CHI '24· Human-LLM Collaboration +1
- 67%
'A Modern Up-To-Date Laptop' - Vagueness in Natural Language Queries for Product Search
DIS '20· Human-LLM Collaboration +1
- 67%
An Exploratory Study on How AI Awareness Impacts Human-AI Design Collaboration
IUI '25· Human-LLM Collaboration +1
- 67%
"It would work for me too": How Online Communities Shape Software Developers’ Trust in AI-Powered Code Generation Tools
IUI '25· Human-LLM Collaboration +1
- 67%
Generative Trigger-Action Programming with Ply
UIST '25· Human-LLM Collaboration +1
- 60%
Tap&Say: Touch Location-Informed Large Language Model for Multimodal Text Correction on Smartphones
CHI '25· Human-LLM Collaboration
Based on Jaccard similarity of research subtopics & professions (≥60%)