Tom Mitchell

schoolCarnegie Mellon Universitybar_chart#5026 Global Rank

Total Papers

HCI Rank

#5026

Research Areas

Years Active

Recent Publications

Screen2Vec: Semantic Embedding of GUI Screens and GUI Components

Representing the semantics of GUI screens and components is crucial to data-driven computational methods for modeling user-GUI interactions and mining GUI designs. Existing GUI semantic representations are limited to encoding either the textual content, the visual design and layout patterns, or the app contexts. Many…

UIST '204th AuthorVoice User Interface (VUI) Design +1

Multi-Modal Repairs of Conversational Breakdowns in Task-Oriented Dialogs

A major problem in task-oriented conversational agents is the lack of support for the repair of conversational breakdowns. Prior studies have shown that current repair strategies for these kinds of errors are often ineffective due to: (1) the lack of transparency about the state of the system’s understanding of the us…

UIST '195th+ AuthorConversational Chatbots +1

PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations

Natural language programming is a promising approach to enable end users to instruct new tasks for intelligent agents. However, our formative study found that end users would often use unclear, ambiguous or vague concepts when naturally instructing tasks in natural language, especially when specifying conditionals. Ex…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/6897?source=all