Conveying Emotions through Shape-changing to Children with and without Visual Impairment

Title of the Paper

Conveying Emotions to Children with and without Visual Impairments through Shape-Changing Interfaces

Bibliographic Information

• Research Domain: Human-Computer Interaction, Shape-Changing Haptics, and Emotional Expression
• Keywords: Soft Robotics, Human-Computer Interaction, Emotional Expression, Experimental Study, Tactile Interaction, Shape-Changing, Nonverbal Behavior, Visual Impairment, Multisensory Feedback

Research Background and Problem

• Research Problem: This study investigates whether differences in children's visual abilities lead to variations in understanding emotional expressions conveyed through shape-changing devices, and how children associate tactile stimuli with emotions.
• Significance of the Research: For child users, especially those with visual impairments, emotional expression and interaction through tactile means could significantly enhance the inclusivity of technology. This also aids in developing hybrid interaction products suitable for users with varying visual abilities.
• Motivation:
  1. The emotional expression capabilities of shape-changing devices have been validated for visually unimpaired adult users, but their impact on mixed-visual-ability populations remains underexplored.
  2. There is currently no design guideline addressing how to create tactile devices capable of expressing emotions for children with or without visual impairments.

Proposed Solution

• Proposed Solution: The research team demonstrated through experiments that children can perceive emotions through tactile stimuli and provided design guidelines tailored for children with and without visual impairments.
• Innovative Aspects:
  • Biologically inspired shape designs (e.g., tentacles, wrinkles, indentations) were used to simulate diverse emotions.
  • Collaboration with psychologists and child educators to design tactile devices and experimental scenarios.
  • For the first time, a quantitative analysis was conducted on the differences in tactile-emotion mapping among children with varying visual abilities (normal vision, low vision, blindness).
• Experimental Steps and Key Techniques:
  • The experiment involved 50 children (aged 6–14, including 26 visually impaired and 24 visually unimpaired children).
  • Five shapes (e.g., tentacles, spikes) and two motion modes (dynamic and static) were used to generate 10 tactile stimuli, which children explored under blindfolded conditions.
  • Emotion-related stories were designed as task prompts, and children were asked to associate the tactile stimuli with the emotions of characters in the stories.
  • A mixed design (shapes and motion as within-subject variables, visual ability as a between-subject variable) was used to statistically analyze differences in tactile-emotion mapping.

Research Findings

• Specific Findings:
  1. Main Discoveries:
     • For the same tactile stimuli, children with different visual abilities associated them with different emotions.
     • Dynamic tentacle shapes were generally perceived as conveying "happiness," while dynamic spikes were strongly associated with "fear" and "anger."
     • Blind children were less likely to associate "indentation" shapes with "sadness," whereas sighted children showed a stronger association.
  2. Statistical Validation:
     • Significant correlations between tactile stimuli and emotional mapping were observed: certain shapes (e.g., dynamic tentacles) were statistically distinguished in their association with specific emotions.
  3. Tactile Motivation Strategies:
     • Children primarily relied on tactile perceptions (shape, texture, motion) for emotional associations, but narrative context had a greater influence on blind children.
• Advantages over Existing Solutions:
  • Expanded the study of shape-emotion associations to include children, particularly incorporating visually impaired children into the research scope.
  • Revealed design requirements for hybrid-visual-ability users and proposed specific application recommendations for tactile content design.
• Experimental or Evaluation Results:
  • The mode of motion (dynamic/static) and movement frequency influenced the intensity of emotional transmission: dynamic shapes were generally used to express high-arousal emotions (e.g., anger and fear), while static shapes were better suited for low-arousal emotions (e.g., calmness).
• Limitations and Future Directions:
  1. Limitations:
     • The cultural background of the sample was homogeneous, limited to one country and language.
     • The sample size of children with varying degrees of visual impairment (e.g., low vision and blindness) was insufficient.
     • The material of the shapes (e.g., spikes and indentations) may have influenced each other due to production constraints.
  2. Future Directions:
     • Expand the study to include a larger sample of children, particularly subdividing groups with low vision and blindness.
     • Explore additional shape designs (e.g., eliminating overlapping skin shapes) to enhance the expression of emotions like "sadness."
     • Introduce EEG or GSR sensors to deepen the objectivity of emotional measurements.

This study provides valuable guidance for designers developing tactile interaction technologies for hybrid-visual-ability populations, particularly in applications such as education, gaming, and emotional regulation devices.