CollabJam: Studying Collaborative Haptic Experience Design for On-Body Vibrotactile Patterns

Research Background and Issues

• What problems or challenges did the authors identify?
  Designing shared vibrotactile experiences requires communication through multiple sensory modalities, especially in remote collaboration scenarios. Designers need to effectively convey intentions and share feedback while constructing and optimizing experiences in real time. This is a complex task because the fundamental parameters of vibrotactile signals (e.g., amplitude and frequency) are not inherently intuitive. Moreover, design patterns and communication mechanisms in co-design processes remain underexplored.

• Why is this issue important?
  Haptic interaction is increasingly utilized in modern devices such as smartphones, virtual reality, and augmented reality systems. As the demand for haptic design grows, providing collaborative tools for designers can accelerate the development and application of haptic interactions while enhancing design outcomes and user experiences.

• Research Motivation and Related Work
  Literature highlights core challenges in haptic experience design (HaXD), including the need for tools that support collaborative design and sharing of haptic experiences, rapid iteration of haptic experiences for real-time feedback, and support for design and communication patterns to enable more effective collaboration. This study aims to address these issues and extend the capabilities of existing tools (e.g., CoTacs and TactJam) for collaborative haptic design.

Proposed Solution

• What methods or solutions did the authors propose?
  The authors proposed an open-source collaborative prototyping tool called "CollabJam" for remotely synchronized design of on-body vibrotactile experiences. CollabJam consists of a software design tool and a hardware control device that manages four vibration actuators, which can be freely placed on the body.

• What is innovative about this solution?
  The system supports real-time collaborative design, allowing multiple remote users to simultaneously control and experience vibrotactile patterns. Compared to existing tools, CollabJam not only supports dynamic recording and playback of vibration patterns but also introduces incremental fine-tuning capabilities. Additionally, it addresses challenges such as recording and verifying actuator placement and minimizing interference.

• What are the implementation steps and key technologies used?

  • Hardware Design: Custom microcontroller modules with BLE functionality drive the vibration actuators, and modular attachment mechanisms were developed to allow users to freely move and adjust component placement.
  • Software Implementation: A cross-platform desktop application based on Electron was developed to control the hardware via Bluetooth and provide real-time collaboration tools, supporting the recording, playback, and editing of vibration patterns.
  • Virtual Rooms: Users can join "virtual rooms" for private or shared collaborative design. The system enables real-time haptic communication and supports features like muting patterns.
  • System Architecture: A client-server architecture supports real-time synchronization and storage of haptic data, with a MongoDB database managing design patterns.

Research Outcomes

• What specific results were achieved?

  • Technical Evaluation: Experiments validated the system's latency levels in device, local, and global collaboration scenarios. Results showed that the system supports synchronized multisensory haptic communication without significantly affecting the collaborative design process.
  • User Study: A total of four pairs of designers participated in the study, which spanned four design stages. Results indicated that CollabJam supports designers in exploring and refining haptic experiences, involving the placement of vibration actuators on various body areas, and effectively facilitates collaborative design.
  • Interaction Pattern Discovery: The study revealed patterns of communication between users regarding design intentions, methods for sharing actuator placement, multisensory communication, and collaborative planning processes.

• What are the advantages compared to existing solutions?

  • Enables real-time "haptic jamming," allowing designers to experiment with and adjust vibration patterns on the fly rather than relying solely on predefined parameters.
  • Supports multiple actuators that can be placed as needed, significantly enhancing design flexibility.
  • Robust multi-user synchronization features provide strong support for real-time remote collaboration.

• What were the experimental or evaluation results?
  Experiments demonstrated that the system's latency (e.g., an average device latency of 64.81 milliseconds) is below the threshold of user perception, enabling smooth interaction. In the user study, designers rated CollabJam highly for its support in exploration, expression, and collaboration, though they expressed a desire for additional feature optimizations.

• Limitations and Future Directions

  • Limitations include the inability to automatically detect or record actuator placement on the body and the lack of functionality to adjust vibration patterns during composition to accommodate individual sensitivity.
  • The authors suggest future tools integrate more communication channels (e.g., video streams) to support audiovisual sharing, provide 3D simulated body representations to assist with actuator placement management, and implement automatic adjustments based on sensory sensitivity.

Conclusion and Design Insights

• Design Insights for the System

  • Provide quick mode-switching functionality to allow simultaneous recording and experimental design.
  • Support copying and reusing parts of vibration patterns across different experiences.
  • Add dynamic, real-time actuator position identification features to assist communication and design.

• Future Work Directions

  • Compare CollabJam with existing tools in terms of design efficiency and user experience.
  • Extend the tool to support other haptic experience designs beyond vibration, such as force feedback or temperature simulation.
  • Explore how to expand haptic connectivity in larger collaborative environments while ensuring privacy protection.