Using Bayes' Theorem for Command Input: Principle, Models, and Applications
Authors
Entering commands on touchscreens can be noisy, but existing interfaces commonly adopt deterministic principles for deciding targets and often result in errors. Building on prior research of using Bayes' theorem to handle uncertainty in input, this paper formalized Bayes' theorem as a generic guiding principle for deciding targets in command input (referred to as "BayesianCommand"), developed three models for estimating prior and likelihood probabilities, and carried out experiments to demonstrate the effectiveness of this formalization. More specifically, we applied BayesianCommand to improve the input accuracy of (1) point-and-click and (2) word-gesture command input. Our evaluation showed that applying BayesianCommand reduced errors compared to using deterministic principles (by over 26.9% for point-and-click and by 39.9% for word-gesture command input) or applying the principle partially (by over 28.0% and 24.5%).
Research Questions / Practical Problems
Question signals indexed for this paper.
- 67%
Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications through Visual Programming
CHI '23· Human-LLM Collaboration +1
- 67%
Enabling Conversational Interaction with Mobile UI using Large Language Models
CHI '23· Voice User Interface (VUI) Design +1
- 67%
CGAT-Net: Context-Aware Graph Attention Transformer Network for Scene Sketch Recognition
IUI '25· Interactive Data Visualization +1
- 67%
On-Device Interaction Mining
MobileHCI '25· Interactive Data Visualization +1
- 67%
Geno: A Developer Tool for Authoring Multimodal Interaction on Existing Web Applications
UIST '20· Voice User Interface (VUI) Design +1
- 67%
Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning
UIST '21· Voice User Interface (VUI) Design +1
- 67%
CoLadder: Manipulating Code Generation via Multi-Level Blocks
UIST '24· Human-LLM Collaboration +1
- 60%
Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study
CHI '20· Computational Methods in HCI
- 60%
What’s The Talk on VUI Guidelines? A Meta-Analysis of Guidelines for Voice User Interface Design
CUI '23· Voice User Interface (VUI) Design
Based on Jaccard similarity of research subtopics & professions (≥60%)