helpResearch questionGUI Semantic Modeling and Task Representation
How can semantic representations simultaneously capture task context, interaction information, and layout patterns of GUI screens?Direction: General AI Systems and Interaction Design
GUI Semantic Modeling and Task Representation
Stats are based on currently indexed question data; missing sources remain visible.
4
items
1
sources
2021
latest
All questions
4 items
helpResearch questionGUI Semantic Modeling and Task Representation
Without manual annotation, can self-supervised learning generate effective semantic embeddings of GUI screens?helpResearch questionGUI Semantic Modeling and Task Representation
How does Screen2Vec perform in broad applicability across multi-task and multi-domain settings?lightbulbPractical problemGUI Semantic Modeling and Task Representation
Existing methods cannot comprehensively capture semantic information of user interaction with GUI screens.Related papers
Adjacent categories
General AI Systems and Interaction Design
Shape-Changing Fabrication and Dynamic Material Interfaces
100 items
General AI Systems and Interaction Design
Model Steering, Latent Space Editing, and Knowledge Injection
60 items
General AI Systems and Interaction Design
Haptic, Force Feedback, and Multisensory Interface Design
57 items
General AI Systems and Interaction Design
Hardware Maintenance and Asynchronous Problem-Solving Support
51 items
General AI Systems and Interaction Design
Sensory Substitution, Cognitive Load, and Blind Operation
44 items
General AI Systems and Interaction Design
Personal Data Reflection and Goal-Setting Support
44 items
General AI Systems and Interaction Design
Attention Orchestration in Multi-Device Environments
43 items
General AI Systems and Interaction Design
Shape-Changing Interfaces and Deformable Display Design
42 items