Rewriting Video: Text-Driven Reauthoring of Video Footage
Best PaperAuthors
Video is a powerful medium for communication and storytelling, yet reauthoring existing footage remains challenging. Even simple edits often demand expertise, time, and careful planning, constraining how creators envision and shape their narratives. Recent advances in generative AI suggest a new paradigm: what if editing a video were as straightforward as rewriting text? To investigate this, we present a tech probe and a study on text-driven video reauthoring. Our approach involves two technical contributions: (1) a generative reconstruction algorithm that reverse-engineers video into an editable text prompt, and (2) an interactive probe, Rewrite Kit, that allows creators to manipulate these prompts. A technical evaluation of the algorithm reveals a critical human-AI perceptual gap. A probe study with 12 creators surfaced novel use cases such as virtual reshooting, synthetic continuity, and aesthetic restyling. It also highlighted key tensions around coherence, control, and creative alignment in this new paradigm. Our work contributes empirical insights into the opportunities and challenges of text-driven video reauthoring, offering design implications for future co-creative video tools.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
Vidmento: Scaffolded Expansion for Video Storytelling with Generative Video
CHI '26· Generative AI (Text, Image, Music, Video) +2
- 71%
VideoDiff: Human-AI Video Co-Creation with Alternatives
CHI '25· Generative AI (Text, Image, Music, Video) +2
- 71%
Protosampling: Enabling Free-Form Convergence of Sampling and Prototyping through Canvas-Driven Visual AI Generation
CHI '26· Generative AI (Text, Image, Music, Video) +2
- 71%
Videostrates: Collaborative, Distributed and Programmable Video Manipulation
UIST '19· Video Production & Editing +1
- 67%
Understanding the Dynamics in Deploying AI-Based Content Creation Support Tools in Broadcasting Systems - Benefits, Challenges, and Directions
CHI '25· Generative AI (Text, Image, Music, Video) +1
- 67%
Videogenic: Identifying Highlight Moments in Videos with Professional Photographs as a Prior
C&C '24· Generative AI (Text, Image, Music, Video) +1
- 67%
Generative Rotoscoping: A First-Person Autobiographical Exploration on Generative Video-to-Video Practices
C&C '25· Generative AI (Text, Image, Music, Video) +1
- 63%
VidTune: Creating Video Soundtracks with Generative Music and Video-Based Thumbnails
CHI '26· Generative AI (Text, Image, Music, Video) +3
- 63%
“It’s more of a vibe I’m going for”: Designing Text-to-Music Generation Interfaces for Video Creators
DIS '25· Generative AI (Text, Image, Music, Video) +3
Based on Jaccard similarity of research subtopics & professions (≥60%)