All

Papers

Browse and search HCI research papers from All

Active Filters

Author: 1873

13 results

Interactive Debugging and Steering of Multi-Agent AI Systems

Fully autonomous teams of LLM-powered AI agents are emerging that collaborate to perform complex tasks for users. What challenges do developers face when trying to build and debug these AI agent teams? In formative interviews with five AI agent developers, we identify core challenges: difficulty reviewing long agent c…

Will Epperson et al.Carnegie Mellon University

Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming

Code-recommendation systems, such as Copilot and CodeWhisperer, have the potential to improve programmer productivity by suggesting and auto-completing code. However, to fully realize their potential, we must understand how programmers interact with these systems and identify ways to improve that interaction. To seek…

Hussein Mozannar et al.Massachusetts Institute of Technology

Understanding Questions that Arise When Working with Business Documents

While digital assistants are increasingly used to help with various productivity tasks, less attention has been paid to employing them in the domain of business documents. To build an agent that can handle users' information needs in this domain, we must first understand the types of assistance that users desire when…

Farnaz Jahanbakhsh et al.University of Michigan

Business Processes & Worker Advocacy; Business Processes & Worker Advocacy

Exploring Interactive Sound Design for Auditory Websites

Auditory interfaces increasingly support access to website content, through recent advances in voice interaction. Typically, however, these interfaces provide only limited audio styling, collapsing rich visual design into a static audio output style with a single synthesized voice. To explore the potential for more ae…

Lotus Zhang et al.University Of Washington

AdRecommended

Learn AI Coding at CodeNow

Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work.

Explore Now

Social Media through Voice: Synthesized Voice Qualities and Self-presentation

With advances in expressive speech synthesis and conversational understanding, an ever-increasing amount of digital content---including social and personal content---can be consumed through voice. Voice has long been known to convey personal characteristics and emotional states, both of which are prominent aspects of…

Lotus Zhang et al.University Of Washington

Voice and Speech

DIY: Helping People Assess the Correctness of Natural Language to SQL Systems

Designing natural language interfaces for querying databases remains an important goal pursued by researchers in natural language processing, databases, and HCI. These systems receive natural language as input, translate it into a formal database query, and execute the query to compute a result. Because the responses…

Arpit Narechania et al.Georgia Institute of Technology

Planning for Natural Language Failures with the AI Playbook

Prototyping AI user experiences is challenging due in part to probabilistic AI models making it difficult to anticipate, test, and mitigate AI failures before deployment. In this work, we set out to support practitioners with early AI prototyping, with a focus on natural language (NL)-based technologies. Our interview…

Matthew K. Hong et al.University Of Washington

"Am I doing this all wrong?" Challenges and Opportunities in Family Information Management

Running a household requires a large amount of labor, from ensuring multiple bills are paid to organizing important documents. Failure to manage such information can have critical consequences for the financial and psychological well-being of the family; however, little is known about how families manage the full scal…

Shruti Sannon et al.Cornell University

Family, Home, and Aging with Technology

Mercury: Empowering Programmers' Mobile Practices with Microproductivity

There has been considerable research on how software can enhance programmers' productivity within their workspace. In this paper, we instead explore how software might help programmers make productive use of their time while away from their workspace. We interviewed 10 software engineers and surveyed 78 others and fou…

Alex C Williams et al.

University of Waterloo

The Impact of Web Browser Reader Views on Reading Speed and User Experience

As reading increasingly shifts from paper to online media, many web browsers now provide a "Reader View,'' which modifies web page layout and design for better readability. However, research has yet to establish whether Reader Views are effective in improving readability and how they might change the user experience.…

Qisheng Li et al.University Of Washington

Guidelines for Human-AI Interaction

Advances in artificial intelligence (AI) frame opportunities and challenges for user interface design. Principles for human-AI interaction have been discussed in the human-computer interaction community for over two decades, but more study and innovation are needed in light of advances in AI and the growing uses of AI…

Saleema Amershi et al.Microsoft

Exploring the Role of Conversational Cues in Guided Task Support with Virtual Assistants

Voice-based conversational assistants are growing in popularity on ubiquitous mobile and stationary devices. Cortana, as well as Google Home, Amazon Echo, and others, can provide support for various tasks from managing reminders to booking a hotel. However, with few exceptions, user input is limited to explicit querie…

Alexandra Vtyurina et al.University of Waterloo

Understanding the Needs of Searchers with Dyslexia

As many as 20% of English speakers have dyslexia, a language disability that impacts reading and spelling. Web search is an important modern literacy skill, yet the accessibility of this language-centric endeavor to people with dyslexia is largely unexplored. We interviewed ten adults with dyslexia and conducted an on…

Meredith Ringel Morris et al.Microsoft

Paper Title	Authors	Research Topics
Interactive Debugging and Steering of Multi-Agent AI Systems Fully autonomous teams of LLM-powered AI agents are emerging that collaborate to perform complex tasks for users. What challenges do developers face when trying to build and debug these AI agent teams? In formative interviews with five AI agent developers, we identify core challenges: difficulty reviewing long agent c…	WE Will Epperson et al.Carnegie Mellon University
emoji_events Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming Code-recommendation systems, such as Copilot and CodeWhisperer, have the potential to improve programmer productivity by suggesting and auto-completing code. However, to fully realize their potential, we must understand how programmers interact with these systems and identify ways to improve that interaction. To seek…	HM Hussein Mozannar et al.Massachusetts Institute of Technology
Understanding Questions that Arise When Working with Business Documents While digital assistants are increasingly used to help with various productivity tasks, less attention has been paid to employing them in the domain of business documents. To build an agent that can handle users' information needs in this domain, we must first understand the types of assistance that users desire when…	FJ Farnaz Jahanbakhsh et al.University of Michigan	Business Processes & Worker Advocacy; Business Processes & Worker Advocacy
Exploring Interactive Sound Design for Auditory Websites Auditory interfaces increasingly support access to website content, through recent advances in voice interaction. Typically, however, these interfaces provide only limited audio styling, collapsing rich visual design into a static audio output style with a single synthesized voice. To explore the potential for more ae…	LZ Lotus Zhang et al.University Of Washington
AdRecommended Learn AI Coding at CodeNow Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work. Explore Now
Social Media through Voice: Synthesized Voice Qualities and Self-presentation With advances in expressive speech synthesis and conversational understanding, an ever-increasing amount of digital content---including social and personal content---can be consumed through voice. Voice has long been known to convey personal characteristics and emotional states, both of which are prominent aspects of…	LZ Lotus Zhang et al.University Of Washington	Voice and Speech
DIY: Helping People Assess the Correctness of Natural Language to SQL Systems Designing natural language interfaces for querying databases remains an important goal pursued by researchers in natural language processing, databases, and HCI. These systems receive natural language as input, translate it into a formal database query, and execute the query to compute a result. Because the responses…	AN Arpit Narechania et al.Georgia Institute of Technology
Planning for Natural Language Failures with the AI Playbook Prototyping AI user experiences is challenging due in part to probabilistic AI models making it difficult to anticipate, test, and mitigate AI failures before deployment. In this work, we set out to support practitioners with early AI prototyping, with a focus on natural language (NL)-based technologies. Our interview…	MH Matthew K. Hong et al.University Of Washington
"Am I doing this all wrong?" Challenges and Opportunities in Family Information Management Running a household requires a large amount of labor, from ensuring multiple bills are paid to organizing important documents. Failure to manage such information can have critical consequences for the financial and psychological well-being of the family; however, little is known about how families manage the full scal…	SS Shruti Sannon et al.Cornell University	Family, Home, and Aging with Technology
Mercury: Empowering Programmers' Mobile Practices with Microproductivity There has been considerable research on how software can enhance programmers' productivity within their workspace. In this paper, we instead explore how software might help programmers make productive use of their time while away from their workspace. We interviewed 10 software engineers and surveyed 78 others and fou…	AW Alex C Williams et al.University of Waterloo
The Impact of Web Browser Reader Views on Reading Speed and User Experience As reading increasingly shifts from paper to online media, many web browsers now provide a "Reader View,'' which modifies web page layout and design for better readability. However, research has yet to establish whether Reader Views are effective in improving readability and how they might change the user experience.…	QL Qisheng Li et al.University Of Washington
emoji_events Guidelines for Human-AI Interaction Advances in artificial intelligence (AI) frame opportunities and challenges for user interface design. Principles for human-AI interaction have been discussed in the human-computer interaction community for over two decades, but more study and innovation are needed in light of advances in AI and the growing uses of AI…	SA Saleema Amershi et al.Microsoft
Exploring the Role of Conversational Cues in Guided Task Support with Virtual Assistants Voice-based conversational assistants are growing in popularity on ubiquitous mobile and stationary devices. Cortana, as well as Google Home, Amazon Echo, and others, can provide support for various tasks from managing reminders to booking a hotel. However, with few exceptions, user input is limited to explicit querie…	AV Alexandra Vtyurina et al.University of Waterloo
Understanding the Needs of Searchers with Dyslexia As many as 20% of English speakers have dyslexia, a language disability that impacts reading and spelling. Web search is an important modern literacy skill, yet the accessibility of this language-centric endeavor to people with dyslexia is largely unexplored. We interviewed ten adults with dyslexia and conducted an on…	MM Meredith Ringel Morris et al.Microsoft