WallTokens: Surface Tangibles for Vertical Displays

Paper Title

WallTokens: Surface Tangibles for Vertical Displays

Paper Information

• Topic Area: Tangible interaction design for horizontal and vertical display surfaces
• Keywords: Tangible Interaction, Tokens, Wall-sized display, Fabrication, Multi-touch gestures

Research Background and Problem

• Problem or Challenge: Interaction design for vertical displays faces challenges due to gravity. Compared to tangible operations on horizontal surfaces, traditional touch gestures lack precision and sensitivity on vertical displays, and are less conducive to multi-user collaboration.
• Importance: Providing more precise and flexible interaction methods on high-resolution large screens has significant practical value, especially for collaborative applications.
• Research Motivation and Related Work:
  • Tangible interaction methods have demonstrated notable advantages on horizontal display surfaces, such as supporting eyes-free control and enhancing collaborative awareness. However, research on their application to vertical screens is limited.
  • Existing solutions are mostly based on touch gestures or external tracking systems, which struggle to efficiently integrate multi-user and multi-modal operations on vertical screens.

Solution

• Proposed Method and Innovation:
  • A new tangible interaction device called WallTokens is introduced, made using lightweight passive hardware components and 3D printing technology. Combined with suction cup design, it enables operations on vertical displays.
  • WallTokens can identify "patterns" (token footprints) at touch points on the wall, allowing for positioning, rotation, and attach/release operations.
• Innovative Features:
  • The use of suction cups addresses gravity challenges, supporting quick attachment and release functions, enabling users to efficiently switch between tangible operations and touch gestures.
  • Provides a low-cost, easily manufacturable prototype model, reducing the technical barriers for expanding tangible interaction development.
• Implementation Steps and Key Technologies:
  1. Use 3D printing technology to fabricate modular components (e.g., push-pull handles, suction cup connectors).
  2. Develop a touch point pattern matching algorithm to enable WallTokens identity and state recognition.
  3. Conduct user experiments to validate the operational precision and performance of WallTokens.

Research Outcomes

• Specific Results:
  • WallTokens demonstrated interaction advantages on vertical displays, allowing users to perform more precise operations on virtual objects.
  • User experiments showed that WallTokens outperformed touch gestures in terms of operational efficiency (task completion time reduced by approximately 26%), fluidity, and comfort.
  • A development framework based on the TUIO protocol was provided, supporting prototype application extensions and multi-user scenarios.
• Comparison with Existing Solutions:
  • Compared to traditional touch gestures, WallTokens offer a more flexible continuous operation experience. Compared to tangible interactions on horizontal surfaces, they effectively address gravity limitations on vertical displays.
• Experimental or Evaluation Results:
  • Experiments designed with virtual objects of varying sizes and rotation angles verified that WallTokens maintain high performance even for small object manipulation.
  • Experiments demonstrated WallTokens' advantages in reducing friction, supporting complex postures, and facilitating collaborative communication.
• Limitations and Future Directions:
  • Limitations: The suction cup design is only applicable to smooth surfaces, and the freedom of tangible manipulation depends on hardware structure.
  • Future Directions: Explore multi-modal interaction technologies combining gestures; incorporate wireless tracking methods to support remote operations.