Pronto: Rapid Augmented Reality Video Prototyping Using Sketches and Enaction
Authors
Designers have limited tools to prototype AR experiences rapidly. Can lightweight, immediate tools let designers prototype dynamic AR interactions while capturing the nuances of a 3D experience? We interviewed three AR experts and identified several recurring issues in AR design: creating and positioning 3D assets, handling the changing user position, and orchestrating multiple animations. We introduce PROJECT PRONTO, a tablet-based video prototyping system that combines 2D video with 3D manipulation. PRONTO supports four intertwined activities: capturing 3D spatial information alongside a video scenario, positioning and sketching 2D drawings in a 3D world, and enacting animations with physical interactions. An observational study with professional designers shows that participants can use PRONTO to prototype diverse AR experiences. All participants performed two tasks: replicating a sample non-trivial AR experience and prototyping their open-ended designs. All participants completed the replication task and found PRONTO easy to use. Most participants found that PRONTO encourages more exploration of designs than their current practices.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 100%
Elements of XR Prototyping: Characterizing the Role and Use of Prototypes in Augmented and Virtual Reality Design
CHI '22· Mixed Reality Workspaces +1
- 75%
Rewire: Interface Design Assistance from Examples
CHI '18· Prototyping & User Testing
- 75%
Poirot: A Web Inspector for Designers
CHI '19· Prototyping & User Testing
- 75%
C-Space: An Interactive Prototyping Platform for Collaborative Spatial Design Exploration
CHI '20· Mixed Reality Workspaces
- 75%
Demystifying Tacit Knowledge in Graphic Design: Characteristics, Instances, Approaches, and Guidelines
CHI '24· Prototyping & User Testing
- 75%
MechARspace: An Authoring System Enabling Bidirectional Binding of AR with Toys in Real-time
UIST '22· Mixed Reality Workspaces
- 60%
Charrette: Supporting In-Person Discussions around Iterations in User Interface Design
CHI '18· Creative Collaboration & Feedback Systems +1
- 60%
SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ
CHI '18· Mixed Reality Workspaces +1
- 60%
It's a Wrap: Mapping On-Skin Input to Off-Skin Displays
CHI '18· Mixed Reality Workspaces +1
- 60%
Swire: Sketch-based User Interface Retrieval
CHI '19· Immersion & Presence Research +1
Based on Jaccard similarity of research subtopics & professions (≥60%)