All

Papers

Browse and search HCI research papers from All

Active Filters

Author: 3785

11 results

Visual Lyrics: Generating Animated Text for Music Lyric Videos with an Augmented Text Editor

Animated lyric videos transform song lyrics into dynamic visual experiences, offering a powerful medium for artistic expression and audience engagement. However, creating these videos is challenging, requiring expertise in audio, typography, graphic design, and animation, making it inaccessible to novices. To address…

David Chuan-En Lin et al.Carnegie Mellon University

VideoDiff: Human-AI Video Co-Creation with Alternatives

To make an engaging video, people sequence interesting moments and add visuals such as B-rolls or text. While video editing requires time and effort, AI has recently shown strong potential to make editing easier through suggestions and automation. A key strength of generative models is their ability to quickly generat…

Mina Huh et al.University of Texas at Austin

Compositional Structures as Substrates for Human-AI Co-creation Environment: A Design Approach and A Case Study

It has been increasingly recognized that effective human-AI co-creation requires more than prompts and results, but an environment with empowering structures that facilitate exploration, planning, iteration, as well as control and inspection of AI generation. Yet, a concrete design approach to such an environment has…

Yining Cao et al.University of California - San Diego

Automated Conversion of Music Videos into Lyric Videos

Musicians and fans often produce lyric videos, a form of music videos that showcase the song's lyrics, for their favorite songs. However, making such videos can be challenging and time-consuming as the lyrics need to be added in synchrony and visual harmony with the video. Informed by prior work and close examination…

Jiaju Ma et al.Stanford University

AdRecommended

Learn AI Coding at CodeNow

Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work.

Explore Now

CatchLive: Real-time Summarization of Live Streams with Stream Content and Interaction Data

Live streams usually last several hours with many viewers joining in the middle. Viewers who join in the middle often want to understand what has happened in the stream. However, catching up with the earlier parts is challenging because it is difficult to know which parts are important in the long, unedited stream whi…

Saelyne Yang et al.Korea Advanced Institute of Science and Technology

SymbolFinder: Brainstorming Diverse Symbols Using Local Semantic Networks

Visual symbols are the building blocks for visual communication. They convey abstract concepts like reform and participation quickly and effectively. When creating graphics with symbols, novice designers often struggle to brainstorm multiple, diverse symbols because they fixate on a few associations instead of broadly…

Savvas Petridis et al.Columbia University

Beyond Show of Hands: Engaging Viewers via Expressive and Scalable Visual Communication in Live Streaming

Live streaming is gaining popularity across diverse application domains in recent years. A core part of the experience is streamer-viewer interaction, which has been mainly text-based. Recent systems explored extending viewer interaction to include visual elements with richer expression and increased engagement. Howev…

John Joon Young Chung et al.Midjourney

Temporal Segmentation of Creative Live Streams

Many artists broadcast their creative process through live streaming platforms like Twitch and YouTube, and people often watch archives of these broadcasts later for learning and inspiration. Unfortunately, because live stream videos are often multiple hours long and hard to skim and browse, few can leverage the wealt…

C. Ailie Fraser et al.University of California

Snapstream: Snapshot-based Interaction in Live Streaming for Visual Art

Live streaming visual art such as drawing or using design software is gaining popularity. An important aspect of live streams is the direct and real-time communication between streamers and viewers. However, currently available text-based interaction limits the expressiveness of viewers as well as streamers, especiall…

Saelyne Yang et al.Korea Advanced Institute of Science and Technology

Generating Audio-Visual Slideshows from Text Articles Using Word Concreteness

We present a system that automatically transforms text articles into audio-visual slideshows by leveraging the notion of word concreteness, which measures how strongly a word or phrase is related to some perceptible concept. In a formative study we learn that people not only prefer such audio-visual slideshows but fin…

Mackenzie Leake et al.Massachusetts Institute of Technology

B-Script: Transcript-based B-roll Video Editing with Recommendations

In video production, inserting B-roll is a widely used technique to enrich the story and make a video more engaging. However, determining the right content and positions of B-roll and actually inserting it within the main footage can be challenging, and novice producers often struggle to get both timing and content ri…

Bernd Huber et al.Harvard University

Paper Title	Authors	Research Topics	Paper Database	Year
Visual Lyrics: Generating Animated Text for Music Lyric Videos with an Augmented Text Editor Animated lyric videos transform song lyrics into dynamic visual experiences, offering a powerful medium for artistic expression and audience engagement. However, creating these videos is challenging, requiring expertise in audio, typography, graphic design, and animation, making it inaccessible to novices. To address…	DL David Chuan-En Lin et al.Carnegie Mellon University
VideoDiff: Human-AI Video Co-Creation with Alternatives To make an engaging video, people sequence interesting moments and add visuals such as B-rolls or text. While video editing requires time and effort, AI has recently shown strong potential to make editing easier through suggestions and automation. A key strength of generative models is their ability to quickly generat…	MH Mina Huh et al.University of Texas at Austin
Compositional Structures as Substrates for Human-AI Co-creation Environment: A Design Approach and A Case Study It has been increasingly recognized that effective human-AI co-creation requires more than prompts and results, but an environment with empowering structures that facilitate exploration, planning, iteration, as well as control and inspection of AI generation. Yet, a concrete design approach to such an environment has…	YC Yining Cao et al.University of California - San Diego
Automated Conversion of Music Videos into Lyric Videos Musicians and fans often produce lyric videos, a form of music videos that showcase the song's lyrics, for their favorite songs. However, making such videos can be challenging and time-consuming as the lyrics need to be added in synchrony and visual harmony with the video. Informed by prior work and close examination…	JM Jiaju Ma et al.Stanford University
AdRecommended Learn AI Coding at CodeNow Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work. Explore Now
CatchLive: Real-time Summarization of Live Streams with Stream Content and Interaction Data Live streams usually last several hours with many viewers joining in the middle. Viewers who join in the middle often want to understand what has happened in the stream. However, catching up with the earlier parts is challenging because it is difficult to know which parts are important in the long, unedited stream whi…	SY Saelyne Yang et al.Korea Advanced Institute of Science and Technology
SymbolFinder: Brainstorming Diverse Symbols Using Local Semantic Networks Visual symbols are the building blocks for visual communication. They convey abstract concepts like reform and participation quickly and effectively. When creating graphics with symbols, novice designers often struggle to brainstorm multiple, diverse symbols because they fixate on a few associations instead of broadly…	SP Savvas Petridis et al.Columbia University
Beyond Show of Hands: Engaging Viewers via Expressive and Scalable Visual Communication in Live Streaming Live streaming is gaining popularity across diverse application domains in recent years. A core part of the experience is streamer-viewer interaction, which has been mainly text-based. Recent systems explored extending viewer interaction to include visual elements with richer expression and increased engagement. Howev…	JC John Joon Young Chung et al.Midjourney
Temporal Segmentation of Creative Live Streams Many artists broadcast their creative process through live streaming platforms like Twitch and YouTube, and people often watch archives of these broadcasts later for learning and inspiration. Unfortunately, because live stream videos are often multiple hours long and hard to skim and browse, few can leverage the wealt…	CF C. Ailie Fraser et al.University of California
Snapstream: Snapshot-based Interaction in Live Streaming for Visual Art Live streaming visual art such as drawing or using design software is gaining popularity. An important aspect of live streams is the direct and real-time communication between streamers and viewers. However, currently available text-based interaction limits the expressiveness of viewers as well as streamers, especiall…	SY Saelyne Yang et al.Korea Advanced Institute of Science and Technology
Generating Audio-Visual Slideshows from Text Articles Using Word Concreteness We present a system that automatically transforms text articles into audio-visual slideshows by leveraging the notion of word concreteness, which measures how strongly a word or phrase is related to some perceptible concept. In a formative study we learn that people not only prefer such audio-visual slideshows but fin…	ML Mackenzie Leake et al.Massachusetts Institute of Technology
B-Script: Transcript-based B-roll Video Editing with Recommendations In video production, inserting B-roll is a widely used technique to enrich the story and make a video more engaging. However, determining the right content and positions of B-roll and actually inserting it within the main footage can be challenging, and novice producers often struggle to get both timing and content ri…	BH Bernd Huber et al.Harvard University