All

Papers

Browse and search HCI research papers from All

Active Filters

Author: 24670

11 results

Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language Models

Large Language Models (LLMs) have become the backbone of numerous writing interfaces with the goal of supporting end-users across diverse writing tasks. While LLMs reduce the effort of manual writing, end-users may need to experiment and iterate with various generation configurations (e.g., inputs and model parameters…

Tae Soo Kim et al.Korea Advanced Institute of Science and Technology

The Prompt Artists

This paper examines the art practices, artwork, and motivations of prolific users of the latest generation of text-to-image (TTI) models. Through interviews, observations, and a survey, we provide a sampling of TTI artwork and find that: 1) the text prompt and the resulting image combine into a single art piece (promp…

Minsuk Chang et al.Google

SoftVideo: Improving the Learning Experience of Software Tutorial Videos with Collective Interaction Data

Many people rely on tutorial videos when learning how to perform tasks using complex software. Watching the video for instructions and applying them to target software require frequent going back-and-forth between the two, which incurs cognitive overhead. Furthermore, users need to constantly compare the two to see if…

Saelyne Yang et al.Korea Advanced Institute of Science and Technology

Speeding up Inference with User Simulators through Policy Modulation

The simulation of user behavior with deep reinforcement learning agents has shown some recent success. However, the inverse problem, that is, inferring the free parameters of the simulator from observed user behaviors, remains challenging to solve. This is because the optimization of the new action policy of the simul…

Hee-Seung Moon et al.Yonsei University

AdRecommended

Learn AI Coding at CodeNow

Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work.

Explore Now

TaleBrush: Sketching Stories with Generative Pretrained Language Models

While advanced text generation algorithms (e.g., GPT-3) have enabled writers to co-create stories with an AI, guiding the narrative remains a challenge. Existing systems often leverage simple turn-taking between the writer and the AI in story development. However, writers remain unsupported in intuitively understandin…

John Joon Young Chung et al.Midjourney

Personalizing Ambience and Illusionary Presence: How People Use “Study with Me” Videos to Create Effective Studying Environments

“Study with me” videos contain footages of people studying for hours, in which social components like conversations or informational content like instructions are absent. Recently, they became increasingly popular on video-sharing platforms. This paper provides the first broad look into what “study with me” videos are…

Yoonjoo Lee et al.Korea Advanced Institute of Science and Technology

A Simulation Model of Intermittently Controlled Point-and-Click Behaviour

We present a novel simulation model of point-and-click behaviour that is applicable both when a target is stationary or moving. To enable more realistic simulation than existing models, the model proposed in this study takes into account key features of the user and the external environment, such as intermittent motor…

Seungwon Do et al.Korea Advanced Institute of Science and Technology

RubySlippers: Supporting Content-based Voice Navigation for How-to Videos

Directly manipulating the timeline, such as scrubbing for thumbnails, is the standard way of controlling how-to videos. However, when how-to videos involve physical activities, people inconveniently alternate between controlling the video and performing the tasks. Adopting a voice user interface allows people to contr…

Minsuk Chang et al.Google

Diagnosing Bias in the Gender Representation of HCI Research Participants: How it Happens and Where We Are

In human-computer interaction (HCI) studies, bias in the gender representation of participants can jeopardize the generalizability of findings, perpetuate bias in data driven practices, and make new technologies dangerous for underrepresented groups. Key to progress towards inclusive and equitable gender practices is…

Anna Offenwanger et al.University of British Columbia

How to Design Voice Based Navigation for How-To Videos

When watching how-to videos related to physical tasks, users' hands are often occupied by the task, making voice input a natural fit. To better understand the design space of voice interactions for how-to video navigation, we conducted three think-aloud studies using: 1) a traditional video interface, 2) a research pr…

Minsuk Chang et al.Google

RecipeScape: An Interactive Tool for Analyzing Cooking Instructions at Scale

For cooking professionals and culinary students, understanding cooking instructions is an essential yet demanding task. Common tasks include categorizing different approaches to cooking a dish and identifying usage patterns of particular ingredients or cooking methods, all of which require extensive browsing and compa…

Minsuk Chang et al.Google

Paper Title	Authors	Research Topics	Paper Database	Year
Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language Models Large Language Models (LLMs) have become the backbone of numerous writing interfaces with the goal of supporting end-users across diverse writing tasks. While LLMs reduce the effort of manual writing, end-users may need to experiment and iterate with various generation configurations (e.g., inputs and model parameters…	TK Tae Soo Kim et al.Korea Advanced Institute of Science and Technology
emoji_events The Prompt Artists This paper examines the art practices, artwork, and motivations of prolific users of the latest generation of text-to-image (TTI) models. Through interviews, observations, and a survey, we provide a sampling of TTI artwork and find that: 1) the text prompt and the resulting image combine into a single art piece (promp…	MC Minsuk Chang et al.Google
SoftVideo: Improving the Learning Experience of Software Tutorial Videos with Collective Interaction Data Many people rely on tutorial videos when learning how to perform tasks using complex software. Watching the video for instructions and applying them to target software require frequent going back-and-forth between the two, which incurs cognitive overhead. Furthermore, users need to constantly compare the two to see if…	SY Saelyne Yang et al.Korea Advanced Institute of Science and Technology
Speeding up Inference with User Simulators through Policy Modulation The simulation of user behavior with deep reinforcement learning agents has shown some recent success. However, the inverse problem, that is, inferring the free parameters of the simulator from observed user behaviors, remains challenging to solve. This is because the optimization of the new action policy of the simul…	HM Hee-Seung Moon et al.Yonsei University
AdRecommended Learn AI Coding at CodeNow Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work. Explore Now
TaleBrush: Sketching Stories with Generative Pretrained Language Models While advanced text generation algorithms (e.g., GPT-3) have enabled writers to co-create stories with an AI, guiding the narrative remains a challenge. Existing systems often leverage simple turn-taking between the writer and the AI in story development. However, writers remain unsupported in intuitively understandin…	JC John Joon Young Chung et al.Midjourney
Personalizing Ambience and Illusionary Presence: How People Use “Study with Me” Videos to Create Effective Studying Environments “Study with me” videos contain footages of people studying for hours, in which social components like conversations or informational content like instructions are absent. Recently, they became increasingly popular on video-sharing platforms. This paper provides the first broad look into what “study with me” videos are…	YL Yoonjoo Lee et al.Korea Advanced Institute of Science and Technology
emoji_events A Simulation Model of Intermittently Controlled Point-and-Click Behaviour We present a novel simulation model of point-and-click behaviour that is applicable both when a target is stationary or moving. To enable more realistic simulation than existing models, the model proposed in this study takes into account key features of the user and the external environment, such as intermittent motor…	SD Seungwon Do et al.Korea Advanced Institute of Science and Technology
RubySlippers: Supporting Content-based Voice Navigation for How-to Videos Directly manipulating the timeline, such as scrubbing for thumbnails, is the standard way of controlling how-to videos. However, when how-to videos involve physical activities, people inconveniently alternate between controlling the video and performing the tasks. Adopting a voice user interface allows people to contr…	MC Minsuk Chang et al.Google
Diagnosing Bias in the Gender Representation of HCI Research Participants: How it Happens and Where We Are In human-computer interaction (HCI) studies, bias in the gender representation of participants can jeopardize the generalizability of findings, perpetuate bias in data driven practices, and make new technologies dangerous for underrepresented groups. Key to progress towards inclusive and equitable gender practices is…	AO Anna Offenwanger et al.University of British Columbia
How to Design Voice Based Navigation for How-To Videos When watching how-to videos related to physical tasks, users' hands are often occupied by the task, making voice input a natural fit. To better understand the design space of voice interactions for how-to video navigation, we conducted three think-aloud studies using: 1) a traditional video interface, 2) a research pr…	MC Minsuk Chang et al.Google
RecipeScape: An Interactive Tool for Analyzing Cooking Instructions at Scale For cooking professionals and culinary students, understanding cooking instructions is an essential yet demanding task. Common tasks include categorizing different approaches to cooking a dish and identifying usage patterns of particular ingredients or cooking methods, all of which require extensive browsing and compa…	MC Minsuk Chang et al.Google