How are Vibrotactile Experiences Visually Represented? A Taxonomy of Illustration Characteristics

Paper Title

How are Vibrotactile Experiences Visually Represented? A Taxonomy of Illustration Characteristics

Publication Info

• Topic area: Visual representation of vibrotactile experiences in scientific communication.
• Keywords: Vibrotactile experiences, visual representation, taxonomy, haptic design, Human–Computer Interaction, scientific illustrations, multimodal communication, tactile feedback, design parameters, user experience.

Background and Problem

• Problem / challenge: There is no shared standard or visual language for illustrating vibrotactile experiences (VTX), making it difficult to communicate their design and experiential dimensions effectively in scientific contexts.
• Significance: Clear and standardized visual representations are crucial for replicability, reproducibility, and effective communication of VTX in research and design.
• Motivation and related work: Previous work has explored taxonomies for interaction illustrations and haptic design tools but has not focused on systematically analyzing or standardizing VTX illustrations. This paper addresses the gap by creating a taxonomy to analyze and improve VTX illustrations.

Solution

• Proposed approach: Development of a taxonomy to characterize and analyze VTX illustrations based on "what" information is presented (e.g., input, output, devices) and "how" it is visually represented (e.g., composition, encoding, visual techniques).
• Novelty:
  1. Creation of a comprehensive taxonomy for VTX illustrations, combining deductive and inductive methods.
  2. Empirical analysis of 768 VTX illustrations from 409 papers using the taxonomy.
  3. Identification of trends, challenges, and gaps in current VTX illustrations.
  4. Demonstration of the taxonomy's utility in reviewing and iterating on VTX illustrations.
• Procedure and key techniques:
  1. Data collection: Systematic review of 1652 papers from ACM and IEEE databases, filtering 768 figures depicting VTX.
  2. Taxonomy development: Deductive design based on prior work and inductive refinement using subsets of the dataset.
  3. Application: Coding and statistical analysis of figures to identify patterns and shortcomings.
  4. Case studies and formative study: Iterative redesign of selected illustrations and evaluation of the taxonomy's utility with 11 participants.

Results

• Concrete findings:
  1. 47.3% of figures depict user input, 70.3% depict device characteristics, and 53.5% depict body parts involved.
  2. 73.2% of VTX illustrations represent static vibration patterns, with limited depiction of time or user actions.
  3. Most illustrations focus on stimuli rather than experiential dimensions (e.g., harmony, immersion).
• Advantage over baselines: The taxonomy provides a structured framework to analyze and improve VTX illustrations, identifying missing or ambiguous information and supporting iterative design.
• Experiments / evaluation:
  1. Statistical analysis of coded figures revealed trends and gaps in current VTX illustrations.
  2. Five case studies demonstrated how the taxonomy can guide the redesign of illustrations to include more comprehensive information.
  3. A formative study with 11 participants (4 experienced, 7 novices) showed that the taxonomy helps reflect on design choices but requires more time to fully integrate into the design process.
• Limitations and future work:
  1. Restricted to ACM and IEEE databases, potentially missing relevant works from other sources.
  2. Analysis focused on figures independently of their textual context, limiting insights into how information is distributed across papers.
  3. Future work could extend the taxonomy to other haptic modalities and explore its integration with AI tools for generating scientific illustrations.

Summary

This paper introduces a taxonomy for analyzing and improving visual representations of vibrotactile experiences (VTX) in scientific communication. By coding 768 figures from 409 papers, the study identifies trends, gaps, and challenges in current VTX illustrations, such as a focus on stimuli over experiential dimensions and limited depiction of user actions or time. The taxonomy supports iterative design by highlighting missing information and sparking ideas, as demonstrated through case studies and a formative study. Future work could expand the taxonomy's scope to other haptic modalities and explore its integration with AI tools for automated illustration design.