triMorph: Bridging Shape-Change and Cross-Sensory Correspondences for Haptic Interaction

Paper Title

triMorph: Bridging Shape-Change and Cross-Sensory Correspondences for Haptic Interaction

Publication Info

• Topic area: Cross-sensory correspondences and dynamic shape-changing interfaces in human-computer interaction.
• Keywords: Shape-change, haptic interaction, Bouba-Kiki effect, cross-sensory correspondences, pneumatic interface, psychophysics, multisensory design, emotion mapping, color association, dynamic transitions.

Background and Problem

• Problem / challenge: Existing research on cross-sensory correspondences primarily focuses on static shapes, leaving gaps in understanding how dynamic shape transitions influence sensory mappings. Few technologies can dynamically transition between spiky, flat, and rounded shapes, and thresholds for perceptual categorization remain unclear.
• Significance: Understanding dynamic cross-sensory correspondences can enhance multisensory interface design, improve user engagement, and expand applications in areas like emotional communication and VR/AR.
• Motivation and related work: Prior studies validate static Bouba-Kiki mappings across modalities (e.g., auditory, visual, haptic) but lack exploration of intermediate shapes and dynamic transitions. Shape-changing technologies are promising but often limited to binary transformations or complex multi-actuator systems.

Solution

• Proposed approach: triMorph, a pneumatic shape-changing interface capable of smoothly transitioning between spiky, flat, and rounded configurations using a single actuator system.
• Novelty:
  1. Development of triMorph, enabling continuous transitions among three fundamental shapes (spiky, flat, rounded).
  2. Psychophysical study quantifying perceptual thresholds (JND and PSE) for shape-sound mappings and exploring shape-color and shape-emotion correspondences.
  3. Empirical insights and design guidelines for cross-sensory interaction devices, validated through user studies.
• Procedure and key techniques:
  • Fabrication of triMorph prototypes using silicone and TPU materials.
  • Controlled pneumatic actuation for smooth transitions between shapes.
  • Psychophysical experiments with 30 participants to measure precision (JND) and accuracy (PSE) in Bouba-Kiki mappings, and associations with color (hue, lightness) and emotions (pleasure, arousal, dominance).

Results

• Concrete findings:
  • Rounded shapes were consistently associated with "Bouba," lighter colors, and pleasant emotions, while spiky shapes were linked to "Kiki," darker colors, and arousing emotions.
  • JND and PSE values showed participants could reliably distinguish shape categories, with thresholds closer to 0 psi for rounded-flat transitions and -0.15 psi for spiky-flat transitions.
  • Larger prototypes slightly improved precision and accuracy but with overlapping error margins.
• Advantage over baselines:
  • triMorph enables continuous shape transitions, unlike prior binary or static systems.
  • Empirical validation of dynamic cross-sensory mappings expands the scope of multisensory HCI.
• Experiments / evaluation:
  • Within-subject design with 30 participants exploring two prototype sizes (16 mm and 32 mm diameter) under 12 air pressure conditions.
  • Tasks included Bouba-Kiki mappings, color associations, and emotion associations, analyzed using psychophysical models and qualitative interviews.
• Limitations and future work:
  • Static exploration of triMorph shapes; future studies should investigate dynamic transitions.
  • Limited demographic diversity; future work should examine cultural and linguistic influences.
  • Potential for scaling triMorph to more complex shapes and modular configurations.

Summary

This paper introduces triMorph, a pneumatic shape-changing interface that transitions smoothly between spiky, flat, and rounded shapes. A psychophysical study with 30 participants quantified perceptual thresholds for Bouba-Kiki mappings and explored associations with color and emotion. Results showed robust cross-sensory correspondences, with rounded shapes linked to "Bouba," lighter colors, and pleasant emotions, and spiky shapes linked to "Kiki," darker colors, and arousing emotions. Findings provide empirical foundations for designing multisensory interfaces and suggest applications in tele-emotion communication, VR/AR shape proxies, and augmented everyday objects. Future work should explore dynamic transitions and broader cultural contexts.