All

Papers

Browse and search HCI research papers from All

Active Filters

Author: 2413

14 results

Visual Lyrics: Generating Animated Text for Music Lyric Videos with an Augmented Text Editor

Animated lyric videos transform song lyrics into dynamic visual experiences, offering a powerful medium for artistic expression and audience engagement. However, creating these videos is challenging, requiring expertise in audio, typography, graphic design, and animation, making it inaccessible to novices. To address…

David Chuan-En Lin et al.Carnegie Mellon University

MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback

Providing asynchronous feedback is a critical step in the 3D design workflow. A common approach to providing feedback is to pair textual comments with companion reference images, which helps illustrate the gist of text. Ideally, feedback providers should possess 3D and image editing skills to create reference images t…

Chen Chen et al.University of California San Diego

PaperToPlace: Transforming Instruction Documents into Spatialized and Context-Aware Mixed Reality Experiences

While paper instructions are one of the mainstream medium for sharing knowledge, consuming such instructions and translating them into activities are inefficient due to the lack of connectivity with physical environment. We present PaperToPlace, a novel workflow comprising an authoring pipeline, which allows the autho…

Chen Chen et al.University of California San Diego

GestureCanvas: A Programming by Demonstration System for Prototyping Compound Freehand Interaction in VR

As the use of hand gestures becomes increasingly prevalent in virtual reality (VR) applications, prototyping Compound Freehand Interactions (CFIs) effectively and efficiently has become a critical need in the design process. Compound Freehand Interaction (CFI) is a sequence of freehand interactions where each sub-inte…

Anika Sayara et al.University of British Columbia

AdRecommended

Learn AI Coding at CodeNow

Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work.

Explore Now

PoseVEC: Authoring Adaptive Pose-aware Effects Using Visual Programming and Demonstrations

Pose-aware visual effects where graphics assets and animations are rendered reactively to the human pose have become increasingly popular, appearing on mobile devices, the web, or even head-mounted displays like AR glasses. Yet, creating such effects still remains difficult for novices. In a traditional video editing…

Yongqi Zhang et al.George Mason University

PointShopAR: Supporting Environmental Design Prototyping Using Point Cloud in Augmented Reality

We present PointShopAR, a novel tablet-based system for AR environmental design using point clouds as the underlying representation. It integrates point cloud capture and editing in a single AR workflow to help users quickly prototype design ideas in their spatial context. We hypothesize that point clouds are well sui…

Zeyu Wang et al.Hong Kong University of Science and Technology

Rapido: Prototyping Interactive AR Experiences through Programming by Demonstration

Programming by Demonstration (PbD) is a well-known technique that allows non-programmers to describe interactivity by performing examples of the expected behavior, but it has not been extensively explored for AR. We present Rapido, a novel early-stage prototyping tool to create fully interactive mobile AR prototypes f…

Germán Leiva et al.Aarhus University

DistanciAR: Authoring Site-Specific Augmented Reality Experiences for Remote Environments

Most augmented reality (AR) authoring tools only support the author's current environment, but designers often need to create site-specific experiences for a different environment. We propose DistanciAR, a novel tablet-based workflow for remote AR authoring. Our baseline solution involves three steps. A remote environ…

Zeyu Wang et al.Hong Kong University of Science and Technology

TransceiVR: Bridging Asymmetrical Communication Between External and VR Users

Virtual Reality (VR) users often need to work with other users, who observe them outside of VR using an external display. Communication between them is difficult; the VR user cannot see the external user’s gestures, and the external user cannot see VR scene elements outside of the VR user’s view. We carried out format…

Balasaravanan Thoravi Kumaravel et al.University of California

View-Dependent Effects for 360° Virtual Reality Video

“View-dependent effects” have parameters that change with the user’s view and are rendered dynamically at runtime. They can be used to simulate physical phenomena such as exposure adaptation, as well as for dramatic purposes such as vignettes. We present a technique for adding view-dependent effects to 360◦ video, by…

Jeremy Hartmann et al.University of Waterloo

Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and Enaction

Designers have limited tools to prototype AR experiences rapidly. Can lightweight, immediate tools let designers prototype dynamic AR interactions while capturing the nuances of a 3D experience? We interviewed three AR experts and identified several recurring issues in AR design: creating and positioning 3D assets, ha…

Germán Leiva et al.Aarhus University

Challenges and Design Considerations for Multimodal Asynchronous Collaboration in VR

Studies on collaborative virtual environments (CVEs) have suggested capture and later replay of multi-modal interactions (e.g., speech, body language, and scene manipulations), which we refer to as multimodal recordings, as an effective medium for time-distributed collaborators to discuss and review 3D content in an i…

Kevin Chow et al.University of British Columbia

VR and immersive interfaces

TutoriVR: A Video-Based Tutorial System for Design Applications in Virtual Reality

Virtual Reality painting is a form of 3D-painting done in a Virtual Reality (VR) space. Being a relatively new kind of art form, there is a growing interest within the creative practices community to learn it. Currently, most users learn using community posted 2D-videos on the internet, which are a screencast recordin…

Balasaravanan Thoravi Kumaravel et al.University of California

Depth Conflict Reduction for Stereo VR Video Interfaces

Applications for viewing and editing 360° video often render user interface (UI) elements on top of the video. For stereoscopic video, in which the perceived depth varies over the image, the perceived depth of the video can conflict with that of the UI elements, creating discomfort and making it hard to shift focus. T…

Cuong Nguyen et al.Adobe

Paper Title	Authors	Research Topics
Visual Lyrics: Generating Animated Text for Music Lyric Videos with an Augmented Text Editor Animated lyric videos transform song lyrics into dynamic visual experiences, offering a powerful medium for artistic expression and audience engagement. However, creating these videos is challenging, requiring expertise in audio, typography, graphic design, and animation, making it inaccessible to novices. To address…	DL David Chuan-En Lin et al.Carnegie Mellon University
MemoVis: A GenAI-Powered Tool for Creating Companion Reference Images for 3D Design Feedback Providing asynchronous feedback is a critical step in the 3D design workflow. A common approach to providing feedback is to pair textual comments with companion reference images, which helps illustrate the gist of text. Ideally, feedback providers should possess 3D and image editing skills to create reference images t…	CC Chen Chen et al.University of California San Diego
PaperToPlace: Transforming Instruction Documents into Spatialized and Context-Aware Mixed Reality Experiences While paper instructions are one of the mainstream medium for sharing knowledge, consuming such instructions and translating them into activities are inefficient due to the lack of connectivity with physical environment. We present PaperToPlace, a novel workflow comprising an authoring pipeline, which allows the autho…	CC Chen Chen et al.University of California San Diego
GestureCanvas: A Programming by Demonstration System for Prototyping Compound Freehand Interaction in VR As the use of hand gestures becomes increasingly prevalent in virtual reality (VR) applications, prototyping Compound Freehand Interactions (CFIs) effectively and efficiently has become a critical need in the design process. Compound Freehand Interaction (CFI) is a sequence of freehand interactions where each sub-inte…	AS Anika Sayara et al.University of British Columbia
AdRecommended Learn AI Coding at CodeNow Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work. Explore Now
PoseVEC: Authoring Adaptive Pose-aware Effects Using Visual Programming and Demonstrations Pose-aware visual effects where graphics assets and animations are rendered reactively to the human pose have become increasingly popular, appearing on mobile devices, the web, or even head-mounted displays like AR glasses. Yet, creating such effects still remains difficult for novices. In a traditional video editing…	YZ Yongqi Zhang et al.George Mason University
PointShopAR: Supporting Environmental Design Prototyping Using Point Cloud in Augmented Reality We present PointShopAR, a novel tablet-based system for AR environmental design using point clouds as the underlying representation. It integrates point cloud capture and editing in a single AR workflow to help users quickly prototype design ideas in their spatial context. We hypothesize that point clouds are well sui…	ZW Zeyu Wang et al.Hong Kong University of Science and Technology
Rapido: Prototyping Interactive AR Experiences through Programming by Demonstration Programming by Demonstration (PbD) is a well-known technique that allows non-programmers to describe interactivity by performing examples of the expected behavior, but it has not been extensively explored for AR. We present Rapido, a novel early-stage prototyping tool to create fully interactive mobile AR prototypes f…	GL Germán Leiva et al.Aarhus University
DistanciAR: Authoring Site-Specific Augmented Reality Experiences for Remote Environments Most augmented reality (AR) authoring tools only support the author's current environment, but designers often need to create site-specific experiences for a different environment. We propose DistanciAR, a novel tablet-based workflow for remote AR authoring. Our baseline solution involves three steps. A remote environ…	ZW Zeyu Wang et al.Hong Kong University of Science and Technology
TransceiVR: Bridging Asymmetrical Communication Between External and VR Users Virtual Reality (VR) users often need to work with other users, who observe them outside of VR using an external display. Communication between them is difficult; the VR user cannot see the external user’s gestures, and the external user cannot see VR scene elements outside of the VR user’s view. We carried out format…	BK Balasaravanan Thoravi Kumaravel et al.University of California
View-Dependent Effects for 360° Virtual Reality Video “View-dependent effects” have parameters that change with the user’s view and are rendered dynamically at runtime. They can be used to simulate physical phenomena such as exposure adaptation, as well as for dramatic purposes such as vignettes. We present a technique for adding view-dependent effects to 360◦ video, by…	JH Jeremy Hartmann et al.University of Waterloo
Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and Enaction Designers have limited tools to prototype AR experiences rapidly. Can lightweight, immediate tools let designers prototype dynamic AR interactions while capturing the nuances of a 3D experience? We interviewed three AR experts and identified several recurring issues in AR design: creating and positioning 3D assets, ha…	GL Germán Leiva et al.Aarhus University
Challenges and Design Considerations for Multimodal Asynchronous Collaboration in VR Studies on collaborative virtual environments (CVEs) have suggested capture and later replay of multi-modal interactions (e.g., speech, body language, and scene manipulations), which we refer to as multimodal recordings, as an effective medium for time-distributed collaborators to discuss and review 3D content in an i…	KC Kevin Chow et al.University of British Columbia	VR and immersive interfaces
TutoriVR: A Video-Based Tutorial System for Design Applications in Virtual Reality Virtual Reality painting is a form of 3D-painting done in a Virtual Reality (VR) space. Being a relatively new kind of art form, there is a growing interest within the creative practices community to learn it. Currently, most users learn using community posted 2D-videos on the internet, which are a screencast recordin…	BK Balasaravanan Thoravi Kumaravel et al.University of California
Depth Conflict Reduction for Stereo VR Video Interfaces Applications for viewing and editing 360° video often render user interface (UI) elements on top of the video. For stereoscopic video, in which the perceived depth varies over the image, the perceived depth of the video can conflict with that of the UI elements, creating discomfort and making it hard to shift focus. T…	CN Cuong Nguyen et al.Adobe