All

Papers

Browse and search HCI research papers from All

Active Filters

Author: 1309

13 results

AnnotateGPT: Designing Human–AI Collaboration in Pen-Based Document Annotation

Providing high-quality feedback on writing is cognitively demanding, requiring reviewers to identify issues, suggest fixes, and ensure consistency. We introduce AnnotateGPT, a system that uses pen-based annotations as an input modality for AI agents to assist with essay feedback. AnnotateGPT enhances feedback by inter…

Benedict Leung et al.University of Ontario Institute of Technology

Viago: Exploring Visual-Audio Modality Transitions for Social Media Consumption on the Go

As mobile phone use while walking becomes increasingly prevalent, users often divide their visual attention between their surroundings and phone displays, raising concerns around safety and interaction efficiency. Alternative input and output modalities, such as eyes-free touch gestures and audio feedback, offer a pro…

Ruei-Che Chang et al.University of Michigan

Gesture and Audio-Haptic Guidance Techniques to Direct Conversations with Intelligent Voice Interfaces

Advances in large language models (LLMs) empower new interactive capabilities for wearable voice interfaces, yet traditional voice-and-audio I/O techniques limit users' ability to flexibly navigate information and manage timing for complex conversational tasks. We developed a suite of gesture and audio-haptic guidance…

Shwetha Rajaram et al.University of Michigan

Transferable Microgestures Across Hand Posture and Location Constraints: Leveraging the Middle, Ring, and Pinky Fingers

Microgestures can enable auxiliary input when the hands are occupied. Although prior work has evaluated the comfort of microgestures performed by the index finger and thumb, these gestures cannot be performed while the fingers are constrained by specific hand locations or postures. As the hand can be freely positioned…

Nikhita Joshi et al.University of Waterloo

AdRecommended

Learn AI Coding at CodeNow

Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work.

Explore Now

STAR: Smartphone-analogous Typing in Augmented Reality

While text entry is an essential and frequent task in Augmented Reality (AR) applications, devising an efficient and easy-to-use text entry method for AR remains an open challenge. This research presents STAR, a smartphone-analogous AR text entry technique that leverages a user's familiarity with smartphone two-thumb…

Taejun Kim et al.Korea Advanced Institute of Science and Technology

Escapement: A Tool for Interactive Prototyping with Video via Sensor-Mediated Abstraction of Time

We present Escapement, a video prototyping tool that introduces a powerful new concept for prototyping screen-based interfaces by flexibly mapping sensor values to dynamic playback control of videos. This recasts the time dimension of video mock-ups as sensor-mediated interaction. This abstraction of time as inter…

Molly Jane Nicholas et al.University of California

TiiS: Learn, Generate, Rank, Explain: A Case Study of Visual Explanation by Generative Machine Learning

Kim 等人提出了一个整合学习、生成、排序与解释功能的视觉解释系统，通过生成式机器学习为用户提供可解释的视觉内容分析。

Chris Kim et al.University of Ontario Institute of Technology

Supporting Serendipitous Discovery and Balanced Analysis of Online Product Reviews with Interaction-Driven Metrics and Bias-Mitigating Suggestions

In this study, we investigate how supporting serendipitous discovery and analysis of online product reviews can encourage readers to explore reviews more comprehensively prior to making purchase decisions. We propose two interventions --- Exploration Metrics that can help readers understand and track their exploration…

Mahmood Jasim et al.University of Massachusetts

Tilt-Responsive Techniques for Digital Drawing Boards

Drawing boards offer a self-stable work surface that is continuously adjustable. On digital displays, such as the Microsoft Surface Studio, these properties open up a class of techniques that sense and respond to tilt adjustments. Each display posture—whether angled high, low, or somewhere in-between—affords some act…

Hugo Romat et al.CNRS

Lexichrome: Text Construction and Lexical Discovery with Word-Color Associations Using Interactive Visualization

Based on word-color associations from a comprehensive, crowdsourced lexicon, we present Lexichrome: a web application that explores the popular perception of relationships between English words and eleven basic color terms using interactive visualization. Lexichrome provides three complementary visualizations: "Palett…

Chris Kim et al.University of Ontario Institute of Technology

Saliency Deficit and Motion Outlier Detection in Animated Scatterplots

We report the results of a crowdsourced experiment that measured the accuracy of motion outlier detection in multivariate, animated scatterplots. The targets were outliers either in speed or direction of motion, and were presented with varying levels of saliency in dimensions that are irrelevant to the task of motion…

Rafael Veras et al.University of Ontario Institute of Technology

ActiveInk: (Th)Inking with Data

During sensemaking, people annotate insights: underlining sentences in a document or circling regions on a map. They jot down their hypotheses: drawing correlation lines on scatterplots or creating personal legends to track patterns. We present ActiveInk, a system enabling people to seamlessly transition between explo…

Hugo Romat et al.CNRS

Metatation: Annotation as Implicit Interaction to Bridge Close and Distant Reading

In the domain of literary criticism, many critics practice close reading, annotating by hand while performing a detailed analysis of a single text. Often this process employs the use of external resources to aid analysis. In this article, we present a study and subsequent tool design focused on leveraging a critic’s a…

Hrim R Mehta et al.University of Ontario Institute of Technology

Paper Title	Authors	Research Topics	Paper Database	Year
AnnotateGPT: Designing Human–AI Collaboration in Pen-Based Document Annotation Providing high-quality feedback on writing is cognitively demanding, requiring reviewers to identify issues, suggest fixes, and ensure consistency. We introduce AnnotateGPT, a system that uses pen-based annotations as an input modality for AI agents to assist with essay feedback. AnnotateGPT enhances feedback by inter…	BL Benedict Leung et al.University of Ontario Institute of Technology
Viago: Exploring Visual-Audio Modality Transitions for Social Media Consumption on the Go As mobile phone use while walking becomes increasingly prevalent, users often divide their visual attention between their surroundings and phone displays, raising concerns around safety and interaction efficiency. Alternative input and output modalities, such as eyes-free touch gestures and audio feedback, offer a pro…	RC Ruei-Che Chang et al.University of Michigan
Gesture and Audio-Haptic Guidance Techniques to Direct Conversations with Intelligent Voice Interfaces Advances in large language models (LLMs) empower new interactive capabilities for wearable voice interfaces, yet traditional voice-and-audio I/O techniques limit users' ability to flexibly navigate information and manage timing for complex conversational tasks. We developed a suite of gesture and audio-haptic guidance…	SR Shwetha Rajaram et al.University of Michigan
Transferable Microgestures Across Hand Posture and Location Constraints: Leveraging the Middle, Ring, and Pinky Fingers Microgestures can enable auxiliary input when the hands are occupied. Although prior work has evaluated the comfort of microgestures performed by the index finger and thumb, these gestures cannot be performed while the fingers are constrained by specific hand locations or postures. As the hand can be freely positioned…	NJ Nikhita Joshi et al.University of Waterloo
AdRecommended Learn AI Coding at CodeNow Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work. Explore Now
STAR: Smartphone-analogous Typing in Augmented Reality While text entry is an essential and frequent task in Augmented Reality (AR) applications, devising an efficient and easy-to-use text entry method for AR remains an open challenge. This research presents STAR, a smartphone-analogous AR text entry technique that leverages a user's familiarity with smartphone two-thumb…	TK Taejun Kim et al.Korea Advanced Institute of Science and Technology
Escapement: A Tool for Interactive Prototyping with Video via Sensor-Mediated Abstraction of Time We present Escapement, a video prototyping tool that introduces a powerful new concept for prototyping screen-based interfaces by flexibly mapping sensor values to dynamic playback control of videos. This recasts the time dimension of video mock-ups as sensor-mediated interaction. This abstraction of time as inter…	MN Molly Jane Nicholas et al.University of California
TiiS: Learn, Generate, Rank, Explain: A Case Study of Visual Explanation by Generative Machine Learning Kim 等人提出了一个整合学习、生成、排序与解释功能的视觉解释系统，通过生成式机器学习为用户提供可解释的视觉内容分析。	CK Chris Kim et al.University of Ontario Institute of Technology
Supporting Serendipitous Discovery and Balanced Analysis of Online Product Reviews with Interaction-Driven Metrics and Bias-Mitigating Suggestions In this study, we investigate how supporting serendipitous discovery and analysis of online product reviews can encourage readers to explore reviews more comprehensively prior to making purchase decisions. We propose two interventions --- Exploration Metrics that can help readers understand and track their exploration…	MJ Mahmood Jasim et al.University of Massachusetts
Tilt-Responsive Techniques for Digital Drawing Boards Drawing boards offer a self-stable work surface that is continuously adjustable. On digital displays, such as the Microsoft Surface Studio, these properties open up a class of techniques that sense and respond to tilt adjustments. Each display posture—whether angled high, low, or somewhere in-between—affords some act…	HR Hugo Romat et al.CNRS
Lexichrome: Text Construction and Lexical Discovery with Word-Color Associations Using Interactive Visualization Based on word-color associations from a comprehensive, crowdsourced lexicon, we present Lexichrome: a web application that explores the popular perception of relationships between English words and eleven basic color terms using interactive visualization. Lexichrome provides three complementary visualizations: "Palett…	CK Chris Kim et al.University of Ontario Institute of Technology
emoji_events Saliency Deficit and Motion Outlier Detection in Animated Scatterplots We report the results of a crowdsourced experiment that measured the accuracy of motion outlier detection in multivariate, animated scatterplots. The targets were outliers either in speed or direction of motion, and were presented with varying levels of saliency in dimensions that are irrelevant to the task of motion…	RV Rafael Veras et al.University of Ontario Institute of Technology
emoji_events ActiveInk: (Th)Inking with Data During sensemaking, people annotate insights: underlining sentences in a document or circling regions on a map. They jot down their hypotheses: drawing correlation lines on scatterplots or creating personal legends to track patterns. We present ActiveInk, a system enabling people to seamlessly transition between explo…	HR Hugo Romat et al.CNRS
Metatation: Annotation as Implicit Interaction to Bridge Close and Distant Reading In the domain of literary criticism, many critics practice close reading, annotating by hand while performing a detailed analysis of a single text. Often this process employs the use of external resources to aid analysis. In this article, we present a study and subsequent tool design focused on leveraging a critic’s a…	HM Hrim R Mehta et al.University of Ontario Institute of Technology