WieldingCanvas: Interactive Sketch Canvases for Freehand Drawing in VR

Document Title

WieldingCanvas: Interactive Sketch Canvases for Freehand Drawing in VR

Document Information

• Subject Area: Interactive freehand drawing technology in Virtual Reality (VR)
• Keywords: Virtual Reality (VR), freehand drawing, interactive canvas, bimanual interaction, 3D drawing, virtual depth perception, Human-Computer Interaction (HCI)

Research Background and Problems

• Problems or Challenges: Freehand drawing in VR presents significant challenges, primarily due to:

  • Lack of physical surface support, leading to reduced drawing precision and control.
  • Insufficient virtual depth perception, resulting in high cognitive and sensorimotor load.
  • Limitations of traditional devices and techniques in improving precision.

• Importance:

  • Advances in VR technology have opened new possibilities for creative activities such as painting, 3D modeling, and sculpting. Addressing the aforementioned challenges is critical to enhancing user experience and creative expression.

• Research Motivation and Related Work:

  • Existing studies have explored improving drawing precision through auxiliary hardware, visual guidance, or automated correction. However, intuitive control over drawing results and seamless spatial interaction remain underexplored.
  • Inspired by rich bimanual creative activities in real life, this study aims to elegantly integrate canvas manipulation with user drawing behavior in VR.

Solution

• Proposed Method or Solution:

  • WieldingCanvas System: An innovative VR drawing platform that addresses freehand drawing precision through interactive canvases. The canvas can rotate, swing, or deform in 3D space, enabling users to create intricate spatial curves by combining drawing and canvas manipulation.
  • Bimanual Interaction Strategy:
    1. The non-drawing hand generates and manipulates the canvas through gestures.
    2. The drawing hand sketches basic patterns, which are then combined with bimanual actions to deform the canvas and create complex 3D curves.

• Innovations:

  • Focuses on active user control rather than full automation, allowing for more intuitive creative expression.
  • Offers a range of canvas manipulation functionalities (e.g., rotation, swinging, folding, twisting) to help users construct complex shapes with ease.
  • Incorporates interaction designs inspired by real-world creative activities, such as pottery wheel spinning or origami folding.

• Implementation Steps and Key Technologies:

  • Gesture Recognition and Virtual Canvas Generation: The non-drawing hand's spatial trajectory generates the canvas, including gestures for circular, linear, and swinging shapes.
  • Canvas Deformation Support: The canvas can bend, stretch, and twist, with 3D curve shapes adjusted using Bézier curve formulas.
  • Audio and Vibration Feedback: Secondary feedback helps users perceive canvas states and enhance the drawing experience.
  • Canvas Management Functions: Supports canvas hiding and display, snapshot features, and combining canvas elements in space.

Research Outcomes

• Specific Results:

  • The design of WieldingCanvas significantly improves drawing precision, smoothness, and control in VR.
  • Two empirical studies validated the system's effectiveness:
    1. Study 1: Basic Shape Drawing: When drawing basic patterns such as circles, straight lines, and arcs, errors were significantly reduced (by over 50%) compared to traditional VR drawing tools, with noticeable improvements in line smoothness.
    2. Study 2: Complex 3D Object Drawing: WieldingCanvas enabled more precise creation of complex objects, with higher user satisfaction compared to existing tools.

• Advantages and Comparison with Existing Solutions:

  • Compared to tools like TiltBrush that rely on direct air drawing, WieldingCanvas provides clear spatial references via virtual canvases, reducing depth perception errors.
  • Unlike traditional freehand drawing solutions, WieldingCanvas's feature set allows users to naturally create complex drawings, facilitating artistic creativity.

• Experiment or Evaluation Results:

  • Drawing Precision: Average errors using WieldingCanvas were significantly lower than traditional VR drawing tools.
  • Drawing Smoothness: Canvas manipulation in WieldingCanvas maintained smoothness in drawing.
  • User Preference: Despite requiring additional time, users expressed higher satisfaction with WieldingCanvas compared to traditional solutions.

• Limitations and Future Directions:

  • Limitations:
    • Beginners may face a learning curve to familiarize themselves with gestures and canvas manipulation.
    • Canvas manipulation methods are more time-consuming than direct drawing.
    • Support for irregular curves remains limited.
  • Future Directions:
    • Expand canvas functionalities to support more curve types.
    • Explore ways to optimize the user learning process and reduce usage time.
    • Further applications and extensions in industrial design, education, and artistic creation.