All

Papers

Browse and search HCI research papers from All

Active Filters

Author: 1445

11 results

Lost in Translation: The Value of Verbalizations in Interpreting 3D Computer-Aided Design Workflows

AI assistants are transforming creative and knowledge domains, holding similar promise for mechanical design via 3D CAD software. Yet, current AI assistance for CAD relies on geometry or command history, lacking rich design intent. We investigate think-aloud computing as a lightweight approach to capture designers' sp…

Kathy Cheng et al.Autodesk

PointAloud: An Interaction Suite for AI-Supported Pointer-Centric Think-Aloud Computing

Think-Aloud Computing, a method for capturing users’ verbalized thoughts during software tasks, allows eliciting rich contextual insights into evolving intentions, struggles, and decision-making processes of users in real-time. However, existing approaches face practical challenges: users often lack awareness of what…

Frederic Gmeiner et al.Autodesk

To Use or Not to Use: Impatience and Overreliance When Using Generative AI Productivity Support Tools

Generative AI has the potential to assist people with completing various tasks, but increased productivity is not guaranteed due to challenges such as uncertainty in output quality and unclear processing time. Through an online crowdsourced experiment (N=508), leveraging a “paint by numbers” task to simulate propertie…

Han Qiao et al.Autodesk

AQuA: Automated Question-Answering in Software Tutorial Videos with Visual Anchors

Tutorial videos are a popular help source for learning feature-rich software. However, getting quick answers to questions about tutorial videos is difficult. We present an automated approach for responding to tutorial questions. By analyzing 633 questions found in 5,944 video comments, we identified different question…

Saelyne Yang et al.Korea Advanced Institute of Science and Technology

AdRecommended

Learn AI Coding at CodeNow

Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work.

Explore Now

3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows

Text-to-image AI are capable of generating novel images for inspiration, but their applications for 3D design workflows and how designers can build 3D models using AI-provided inspiration have not yet been explored. To investigate this, we integrated DALL-E, GPT-3, and CLIP within a CAD software in 3DALL-E, a plugin t…

Vivian Liu et al.Columbia University

AvatAR: An Immersive Analysis Environment for Human Motion Data Combining Interactive 3D Avatars and Trajectories

Analysis of human motion data can reveal valuable insights about the utilization of space and interaction of humans with their environment. To support this, we present AvatAR, an immersive analysis environment for the in-situ visualization of human motion data, that combines 3D trajectories, virtual avatars of people’…

Patrick Reipschläger et al.Autodesk

Supercharging Trial-and-Error for Learning Complex Software Applications

Despite an abundance of carefully-crafted tutorials, trial-and-error remains many people’s preferred way to learn complex software. Yet, approaches to facilitate trial-and-error (such as tooltips) have evolved very little since the 1980s. While existing mechanisms work well for simple software, they scale poorly to la…

Damien Masson et al.University of Montreal

Think-Aloud Computing: Supporting Rich and Low-Effort Knowledge Capture

When users complete tasks on the computer, the knowledge they leverage and their intent is often lost because it is tedious or challenging to capture. This makes it harder to understand why a colleague designed a component a certain way or to remember requirements for software you wrote a year ago. We introduce think-…

Rebecca Krosnick et al.University of Michigan

MicroMentor: Peer-to-Peer Software Help Sessions in Three Minutes or Less

While synchronous one-on-one help for software learning is rich and valuable, it can be difficult to find and connect with someone who can provide assistance. Through a formative user study, we explore the idea of fixed-duration, one-on-one help sessions and find that 3 minutes is often enough time for novice users to…

Nikhita Joshi et al.University of Waterloo

Geppetto: Enabling Semantic Design of Expressive Robot Behaviors

Expressive robots are useful in many contexts, from industrial to entertainment applications. However, designing expressive robot behaviors requires editing a large number of unintuitive control parameters. We present an interactive, data-driven system that allows editing of these complex parameters in a semantic spac…

Ruta Desai et al.Carnegie Mellon University

Dream Lens: Exploration and Visualization of Large-Scale Generative Design Datasets

This paper presents Dream Lens, an interactive visual analysis tool for exploring and visualizing large-scale generative design datasets. Unlike traditional computer aided design, where users create a single model, with generative design, users specify high-level goals and constraints, and the system automatically gen…

Justin Matejka et al.Autodesk

Paper Title	Authors	Research Topics	Paper Database	Year
Lost in Translation: The Value of Verbalizations in Interpreting 3D Computer-Aided Design Workflows AI assistants are transforming creative and knowledge domains, holding similar promise for mechanical design via 3D CAD software. Yet, current AI assistance for CAD relies on geometry or command history, lacking rich design intent. We investigate think-aloud computing as a lightweight approach to capture designers' sp…	KC Kathy Cheng et al.Autodesk
PointAloud: An Interaction Suite for AI-Supported Pointer-Centric Think-Aloud Computing Think-Aloud Computing, a method for capturing users’ verbalized thoughts during software tasks, allows eliciting rich contextual insights into evolving intentions, struggles, and decision-making processes of users in real-time. However, existing approaches face practical challenges: users often lack awareness of what…	FG Frederic Gmeiner et al.Autodesk
To Use or Not to Use: Impatience and Overreliance When Using Generative AI Productivity Support Tools Generative AI has the potential to assist people with completing various tasks, but increased productivity is not guaranteed due to challenges such as uncertainty in output quality and unclear processing time. Through an online crowdsourced experiment (N=508), leveraging a “paint by numbers” task to simulate propertie…	HQ Han Qiao et al.Autodesk
AQuA: Automated Question-Answering in Software Tutorial Videos with Visual Anchors Tutorial videos are a popular help source for learning feature-rich software. However, getting quick answers to questions about tutorial videos is difficult. We present an automated approach for responding to tutorial questions. By analyzing 633 questions found in 5,944 video comments, we identified different question…	SY Saelyne Yang et al.Korea Advanced Institute of Science and Technology
AdRecommended Learn AI Coding at CodeNow Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work. Explore Now
3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows Text-to-image AI are capable of generating novel images for inspiration, but their applications for 3D design workflows and how designers can build 3D models using AI-provided inspiration have not yet been explored. To investigate this, we integrated DALL-E, GPT-3, and CLIP within a CAD software in 3DALL-E, a plugin t…	VL Vivian Liu et al.Columbia University
AvatAR: An Immersive Analysis Environment for Human Motion Data Combining Interactive 3D Avatars and Trajectories Analysis of human motion data can reveal valuable insights about the utilization of space and interaction of humans with their environment. To support this, we present AvatAR, an immersive analysis environment for the in-situ visualization of human motion data, that combines 3D trajectories, virtual avatars of people’…	PR Patrick Reipschläger et al.Autodesk
Supercharging Trial-and-Error for Learning Complex Software Applications Despite an abundance of carefully-crafted tutorials, trial-and-error remains many people’s preferred way to learn complex software. Yet, approaches to facilitate trial-and-error (such as tooltips) have evolved very little since the 1980s. While existing mechanisms work well for simple software, they scale poorly to la…	DM Damien Masson et al.University of Montreal
Think-Aloud Computing: Supporting Rich and Low-Effort Knowledge Capture When users complete tasks on the computer, the knowledge they leverage and their intent is often lost because it is tedious or challenging to capture. This makes it harder to understand why a colleague designed a component a certain way or to remember requirements for software you wrote a year ago. We introduce think-…	RK Rebecca Krosnick et al.University of Michigan
MicroMentor: Peer-to-Peer Software Help Sessions in Three Minutes or Less While synchronous one-on-one help for software learning is rich and valuable, it can be difficult to find and connect with someone who can provide assistance. Through a formative user study, we explore the idea of fixed-duration, one-on-one help sessions and find that 3 minutes is often enough time for novice users to…	NJ Nikhita Joshi et al.University of Waterloo
emoji_events Geppetto: Enabling Semantic Design of Expressive Robot Behaviors Expressive robots are useful in many contexts, from industrial to entertainment applications. However, designing expressive robot behaviors requires editing a large number of unintuitive control parameters. We present an interactive, data-driven system that allows editing of these complex parameters in a semantic spac…	RD Ruta Desai et al.Carnegie Mellon University
Dream Lens: Exploration and Visualization of Large-Scale Generative Design Datasets This paper presents Dream Lens, an interactive visual analysis tool for exploring and visualizing large-scale generative design datasets. Unlike traditional computer aided design, where users create a single model, with generative design, users specify high-level goals and constraints, and the system automatically gen…	JM Justin Matejka et al.Autodesk