All

Papers

Browse and search HCI research papers from All

Active Filters

Author: 16241

13 results

'Show It, Don't Just Say It': The Complementary Effects of Instruction Multimodality for Software Guidance

Designing adaptive tutoring systems for software learning presents challenges in determining appropriate instructional modalities. To inform the design of such systems, we conducted an observational study of ten human teacher-student pairs (N=20), where experienced design software users taught novices two new graphic…

Emran Poh et al.Singapore Management University

Prompting an Embodied AI Agent: How Embodiment and Multimodal Signaling Affects Prompting Behaviour

Current voice agents wait for a user to complete their verbal instruction before responding; yet, this is misaligned with how humans engage in everyday conversational interaction, where interlocutors use multimodal signaling (e.g. nodding, grunting, or looking at referred to objects) to ensure conversational grounding…

Tianyi Zhang et al.Singapore Management University

Desk2Desk: Optimization-based Mixed Reality Workspace Integration for Remote Side-by-side Collaboration

Mixed Reality enables hybrid workspaces where physical and virtual monitors are adaptively created and moved to suit the current environment and needs. However, in shared settings, individual users’ workspaces are rarely aligned and can vary significantly in the number of monitors, available physical space, and worksp…

Ludwig Sidenmark et al.University of Toronto

How People Prompt Generative AI to Create Interactive VR Scenes

Generative AI tools can provide people with the ability to create virtual environments and scenes with natural language prompts. Yet, \textit{how} people will formulate such prompts is unclear---particularly when they inhabit the environment that they are designing. For instance, it is likely that a person might say,…

Setareh Aghel Manesh et al.University of Calgary

AdRecommended

Learn AI Coding at CodeNow

Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work.

Explore Now

Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues

Live and pre-recorded video tutorials are an effective means for teaching physical skills such as cooking or prototyping electronics. A dedicated cameraperson following an instructor’s activities can improve production quality. However, instructors who do not have access to a cameraperson’s help often have to work wi…

Jiannan Li et al.Singapore Management University

Tourgether360: Collaborative Exploration of 360 Tour Videos using Pseudo-Spatial Navigation

Collaborative exploration of 360° videos with contemporary interfaces is challenging because collaborators do not have awareness of one another’s viewing activities. Tourgether360 enhances social exploration of 360° tour videos using a pseudo-spatial navigation technique that provides both an overhead “context” view o…

Kartikaeya Kumar et al.Indian Institute of Technology

XR Collaboration; XR Collaboration

immersivePOV: Filming How-To Videos with a Head-Mounted 360° Action Camera

How-to videos are often shot using camera angles that may not be optimal for learning motor tasks, with a prevalent use of third-person perspective. We present \textit{immersivePOV}, an approach to film how-to videos from an immersive first-person perspective using a head-mounted 360° action camera. immersivePOV how-t…

Kevin Huang et al.University of Toronto

ASTEROIDS: Exploring Swarms of Mini-Telepresence Robots for Physical Skill Demonstration

Online synchronous tutoring allows for immediate engagement between instructors and audiences over distance. However, tutoring physical skills remains challenging because current telepresence approaches may not allow for adequate spatial awareness, viewpoint control of the demonstration activities scattered across an…

Jiannan Li et al.Singapore Management University

Route Tapestries: Navigating 360 Virtual Tour Videos Using Slit-Scan Visualizations

An increasingly popular way of experiencing remote places is by viewing 360 virtual tour videos, which show the surrounding view while traveling through an environment. However, finding particular locations in these videos can be difficult because current interfaces rely on distorted frame previews for navigation. To…

Jiannan Li et al.Singapore Management University

HoloBoard: a Large-format Immersive Teaching Board based on Pseudo HoloGraphics

In this paper, we present HoloBoard, an interactive large-format pseduo-holographic display system for lecture based classes. With its unique properties of immersive visual display and transparent screen, we designed and implemented a rich set of novel interaction techniques like immersive presentation, role-play, and…

Jiangtao Gong et al.Lenovo

More Kawaii than a Real-Person Streamer: Understanding How the Otaku Community Engages with and Perceives Virtual YouTubers

Live streaming has become increasingly popular, with most streamers presenting their real-life appearance. However, Virtual YouTubers (VTubers), virtual 2D or 3D avatars that are voiced by humans, are emerging as live streamers and attracting a growing viewership in East Asia. Although prior research has found that ma…

Zhicong Lu et al.University of Toronto

PinchList: Leveraging Pinch Gestures for Hierarchical List Navigation on Smartphones

Intensive exploration and navigation of hierarchical lists on smartphones can be tedious and time-consuming as it often requires users to frequently switch between multiple views. To overcome this limitation, we present PinchList, a novel interaction design that leverages pinch gestures to support seamless exploration…

Teng Han et al.University of Manitoba

PageFlip: Leveraging Page-Flipping Gestures for Efficient Command and Value Selection on Smartwatches

Selecting an item of interest on smartwatches can be tedious and time-consuming as it involves a series of swipe and tap actions. We present PageFlip, a novel method that combines into a single action multiple touch operations such as command invocation and value selection for efficient interaction on smartwatches. Pa…

Teng Han et al.University of Manitoba

Paper Title	Authors	Research Topics
'Show It, Don't Just Say It': The Complementary Effects of Instruction Multimodality for Software Guidance Designing adaptive tutoring systems for software learning presents challenges in determining appropriate instructional modalities. To inform the design of such systems, we conducted an observational study of ten human teacher-student pairs (N=20), where experienced design software users taught novices two new graphic…	EP Emran Poh et al.Singapore Management University
emoji_events Prompting an Embodied AI Agent: How Embodiment and Multimodal Signaling Affects Prompting Behaviour Current voice agents wait for a user to complete their verbal instruction before responding; yet, this is misaligned with how humans engage in everyday conversational interaction, where interlocutors use multimodal signaling (e.g. nodding, grunting, or looking at referred to objects) to ensure conversational grounding…	TZ Tianyi Zhang et al.Singapore Management University
Desk2Desk: Optimization-based Mixed Reality Workspace Integration for Remote Side-by-side Collaboration Mixed Reality enables hybrid workspaces where physical and virtual monitors are adaptively created and moved to suit the current environment and needs. However, in shared settings, individual users’ workspaces are rarely aligned and can vary significantly in the number of monitors, available physical space, and worksp…	LS Ludwig Sidenmark et al.University of Toronto
How People Prompt Generative AI to Create Interactive VR Scenes Generative AI tools can provide people with the ability to create virtual environments and scenes with natural language prompts. Yet, \textit{how} people will formulate such prompts is unclear---particularly when they inhabit the environment that they are designing. For instance, it is likely that a person might say,…	SM Setareh Aghel Manesh et al.University of Calgary
AdRecommended Learn AI Coding at CodeNow Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work. Explore Now
Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues Live and pre-recorded video tutorials are an effective means for teaching physical skills such as cooking or prototyping electronics. A dedicated cameraperson following an instructor’s activities can improve production quality. However, instructors who do not have access to a cameraperson’s help often have to work wi…	JL Jiannan Li et al.Singapore Management University
Tourgether360: Collaborative Exploration of 360 Tour Videos using Pseudo-Spatial Navigation Collaborative exploration of 360° videos with contemporary interfaces is challenging because collaborators do not have awareness of one another’s viewing activities. Tourgether360 enhances social exploration of 360° tour videos using a pseudo-spatial navigation technique that provides both an overhead “context” view o…	KK Kartikaeya Kumar et al.Indian Institute of Technology	XR Collaboration; XR Collaboration
emoji_events immersivePOV: Filming How-To Videos with a Head-Mounted 360° Action Camera How-to videos are often shot using camera angles that may not be optimal for learning motor tasks, with a prevalent use of third-person perspective. We present \textit{immersivePOV}, an approach to film how-to videos from an immersive first-person perspective using a head-mounted 360° action camera. immersivePOV how-t…	KH Kevin Huang et al.University of Toronto
ASTEROIDS: Exploring Swarms of Mini-Telepresence Robots for Physical Skill Demonstration Online synchronous tutoring allows for immediate engagement between instructors and audiences over distance. However, tutoring physical skills remains challenging because current telepresence approaches may not allow for adequate spatial awareness, viewpoint control of the demonstration activities scattered across an…	JL Jiannan Li et al.Singapore Management University
Route Tapestries: Navigating 360 Virtual Tour Videos Using Slit-Scan Visualizations An increasingly popular way of experiencing remote places is by viewing 360 virtual tour videos, which show the surrounding view while traveling through an environment. However, finding particular locations in these videos can be difficult because current interfaces rely on distorted frame previews for navigation. To…	JL Jiannan Li et al.Singapore Management University
HoloBoard: a Large-format Immersive Teaching Board based on Pseudo HoloGraphics In this paper, we present HoloBoard, an interactive large-format pseduo-holographic display system for lecture based classes. With its unique properties of immersive visual display and transparent screen, we designed and implemented a rich set of novel interaction techniques like immersive presentation, role-play, and…	JG Jiangtao Gong et al.Lenovo
More Kawaii than a Real-Person Streamer: Understanding How the Otaku Community Engages with and Perceives Virtual YouTubers Live streaming has become increasingly popular, with most streamers presenting their real-life appearance. However, Virtual YouTubers (VTubers), virtual 2D or 3D avatars that are voiced by humans, are emerging as live streamers and attracting a growing viewership in East Asia. Although prior research has found that ma…	ZL Zhicong Lu et al.University of Toronto
PinchList: Leveraging Pinch Gestures for Hierarchical List Navigation on Smartphones Intensive exploration and navigation of hierarchical lists on smartphones can be tedious and time-consuming as it often requires users to frequently switch between multiple views. To overcome this limitation, we present PinchList, a novel interaction design that leverages pinch gestures to support seamless exploration…	TH Teng Han et al.University of Manitoba
PageFlip: Leveraging Page-Flipping Gestures for Efficient Command and Value Selection on Smartwatches Selecting an item of interest on smartwatches can be tedious and time-consuming as it involves a series of swipe and tap actions. We present PageFlip, a novel method that combines into a single action multiple touch operations such as command invocation and value selection for efficient interaction on smartwatches. Pa…	TH Teng Han et al.University of Manitoba