Agile 3D Sketching with Air Scaffolding
Best PaperAuthors
Hand motion and pen drawing can be intuitive and expressive inputs for professional digital 3D authoring. However, their inherent limitations have hampered wider adoption. 3D sketching using hand motion is rapid but rough, and 3D sketching using pen drawing is delicate but tedious. Our new 3D sketching workflow combines these two in a complementary manner. The user makes quick hand motions in the air to generate approximate 3D shapes, and uses them as scaffolds on which to add details via pen-based 3D sketching on a tablet device. Our air scaffolding technique and corresponding algorithm extract only the intended shapes from unconstrained hand motions. Then, the user sketches 3D ideas by defining sketching planes on these scaffolds while appending new scaffolds, as needed. A user study shows that our progressive and iterative workflow enables more agile 3D sketching compared to ones using either hand motion or pen drawing alone.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 60%
VirtualGrasp: Leveraging Experience of Interacting with Physical Objects to Facilitate Digital Object Retrieval
CHI '18· Hand Gesture Recognition +1
- 60%
SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ
CHI '18· Mixed Reality Workspaces +1
- 60%
Sensing Posture-Aware Pen+Touch Interaction on Tablets
CHI '19· Hand Gesture Recognition +1
- 60%
CASSIE: Curve and Surface Sketching in Immersive Environments
CHI '21· Immersion & Presence Research +1
- 60%
The Impact of Sketch-guided vs. Prompt-guided 3D Generative AIs on the Design Exploration Process
CHI '24· Generative AI (Text, Image, Music, Video) +1
- 60%
Spatial Hand Actions: Exploring the Hand Actions used to Represent Spatial Thinking for 3D Assembling Tasks
CHI '25· Hand Gesture Recognition +2
- 60%
FusionProtor: A Mixed-Prototype Tool for Component-level Physical-to-Virtual 3D Transition and Simulation
CHI '25· 3D Modeling & Animation +1
- 60%
A Scaffold-Based Tool for Product Design Variations in Virtual Reality
CHI '25· Mixed Reality Workspaces +1
- 60%
An empirical comparison of Moderated and Unmoderated Gesture Elicitation Studies on soft surfaces and objects for smart home control.
MobileHCI '23· Hand Gesture Recognition +1
- 60%
Self-Distillation Based Multi-task Learning Model for Stylus Input Latency Compensation
MobileHCI '25· Force Feedback & Pseudo-Haptic Weight +1
Based on Jaccard similarity of research subtopics & professions (≥60%)