Exploring Texture-Level Creative Decisions with penPal, a Novel Handheld Actuated Drawing Tool

Paper Title

Exploring Texture-Level Creative Decisions with penPal, a Novel Handheld Actuated Drawing Tool

Publication Info

• Topic area: Human-Computer Interaction (HCI) focusing on augmented handheld tools for artistic drawing.
• Keywords: Drawing tools, texture, computational creativity, handheld devices, actuated tools, human-machine collaboration, mark-making, creative exploration, scale transitions.

Background and Problem

• Problem / challenge: Traditional drawing tools lack computational flexibility, while digital tools often sacrifice directness and embodied skill. There is limited integration of computational capabilities into physical drawing tools that preserve intuitive control and expressive range.
• Significance: Bridging computational speed and reconfigurability with the tactile and intuitive qualities of physical drawing tools could enhance creative practices and enable novel artistic exploration.
• Motivation and related work: Prior work in HCI has explored sketch-based inputs, robotic drawing tools, and digital brushes, but these often focus on industrial or purely digital contexts. Artistic practices emphasize mark-making and texture, which are underexplored in computationally augmented physical tools. This paper builds on these gaps to develop a system that supports texture-level creativity.

Solution

• Proposed approach: penPal, a handheld actuated drawing tool with a tendon-driven continuum robot tip, enabling dynamic mark-making and texture-level creative control.
• Novelty:
  1. Art-informed understanding of drawn texture as a middle-level property for designing computational drawing tools.
  2. Development of penPal, a modular, handheld drawing tool with actuated tip motion controlled via a GUI.
  3. Empirical study with 10 participants and a professional artist to explore texture-level drawing practices and human-machine negotiation.
  4. Insights into selective defamiliarization and fluid transitions between mark, texture, and composition levels in drawing.
• Procedure and key techniques:
  • Hardware: Modular 3D-printed body, tendon-driven continuum robot tip, interchangeable drawing tips, and servomotors for actuation.
  • Software: GUI for motion path input, parameter adjustment, and path normalization; empirical lookup-table and mathematical modeling for tip motion control.
  • User study: Exploratory tasks, shading exercises, and open-ended drawing sessions with interviews and thematic analysis.

Results

• Concrete findings:
  • Participants used penPal to create diverse textures and explored novel drawing strategies.
  • Experienced artists described penPal as both an extension of their body and a collaborator, while novices focused more on utilitarian aspects.
  • Professional artist highlighted penPal’s ability to automate repetitive tasks while introducing unique mark-making possibilities.
• Advantage over baselines: penPal combines computational flexibility with embodied control, supporting texture-level creativity in ways that traditional and digital tools do not.
• Experiments / evaluation:
  • 10 participants with varied drawing experience completed structured and open-ended tasks, followed by interviews.
  • Professional artist commissioned to use penPal for two hours and provide reflections.
  • Data collected through video, audio, artwork, and thematic analysis.
• Limitations and future work:
  • Prototype weight distribution and actuator design could be improved for comfort and safety.
  • GUI could be expanded to include more input modalities and optimized path-planning.
  • Long-term in-the-wild deployments needed to understand professional integration.

Summary

This paper introduces penPal, a novel handheld actuated drawing tool designed to support texture-level creative decisions by combining computational motion with manual control. Through a user study and professional artist engagement, the authors demonstrate how penPal enables fluid transitions between mark, texture, and composition levels, fostering creative exploration and negotiated control. Findings highlight the tool’s potential to selectively defamiliarize drawing processes, enhancing artistic practices. Future work aims to refine the hardware and software for broader usability and extended deployments.