Nathan G Huang

Tap&Say: Touch Location-Informed Large Language Model for Multimodal Text Correction on Smartphones

While voice input offers a convenient alternative to traditional text editing on mobile devices, practical implementations face two key challenges: 1) reliably distinguishing between editing commands and content dictation, and 2) effortlessly pinpointing the intended edit location. We propose Tap&Say, a novel multimod…