Understanding tensions in music accessibility through song signing for and with d/Deaf and Non-d/Deaf persons

Title of the Paper

Understanding Tensions in Music Accessibility: Performing Signed Songs For and With d/Deaf and Non-d/Deaf Individuals

Paper Information

• Subject Area: Assistive Technology and Accessibility Design, Deaf Culture, Musical Arts
• Keywords: Accessibility, Music, Signed Song Performance, d/Deaf or Hard of Hearing Individuals, Assistive Technology, Cross-Cultural Collaboration, Deaf Culture Responsiveness
• Source: CHI ’23 Conference Proceedings, April 2023, Hamburg, Germany

Research Background and Issues

• Issues and Challenges:

  • The ways d/Deaf (Deaf or hard of hearing) individuals engage with music are diverse, yet many existing tools fail to reflect their actual needs and values.
  • The cultural value and appeal of signed song performances within the Deaf community remain underexplored.
  • Cross-cultural collaborations in signed song performances may raise cultural sensitivity concerns, such as criticism of non-Deaf performers for cultural appropriation or misunderstanding of Deaf culture.

• Significance:

  • Music is a vital form of cultural expression, influencing both personal cultural identity and mental well-being.
  • Enhancing music accessibility can bridge the cultural divide between Deaf and non-Deaf communities, fostering social inclusion.
  • Better-designed and performed signed songs can offer new musical experiences to a broader audience while respecting and promoting Deaf culture.

• Research Motivation and Goals:

  • To explore the values and needs of d/Deaf individuals regarding music and signed performances.
  • To understand the challenges faced by creators of signed songs in improving the production process and fostering cultural integration.
  • To provide design guidelines and research opportunities for creating Deaf culture-responsive content.

• Key Research Questions:

  1. What musical qualities do d/Deaf individuals value most, and can signed songs make these qualities accessible?
  2. What practices and challenges do singers or signed song performers (both Deaf and non-Deaf) encounter during the creation of signed song performances?
  3. How can design guidelines be developed to promote the creation of Deaf culture-responsive musical content?

Solutions

• Research Methods:

  • Conducted semi-structured interviews with 12 d/Deaf audience members and 14 signed song performers to analyze their understanding and creation processes of signed songs.
  • Identified three key levels in the creation of signed songs: technical translation, artistic expression, and cultural representation.

• Key Techniques and Steps:

  • Technical Translation Layer: Semantic translation of lyrics (understanding the meaning of lyrics) and syntactic translation (converting lyrics into sign language synchronized with music).
  • Artistic Expression Layer: Conveying emotions and visual elements of music (e.g., rhythm, instruments, and tone) through gestures, body language, and facial expressions.
  • Cultural Representation Layer: Faithfully expressing Deaf language and culture while avoiding linguistic and cultural misunderstandings.

• Major Innovations:

  • Identified differences in musical priorities between d/Deaf and non-d/Deaf performers.
  • Proposed a complex, interactive workflow model for signed song production, laying the groundwork for improved technical design and culturally sensitive collaboration.
  • Encouraged collaboration between Deaf and hearing individuals to bridge cultural gaps and foster mutual understanding and co-creation.

Research Findings

• Specific Findings:

  • d/Deaf individuals place greater emphasis on lyrics, emotions, and temporal synchronization in music, rather than pitch, instruments, or volume.
  • Revealed the three-layered process of signed song production, including challenges in translation and emotional expression.
  • Deaf audiences prefer signed song content created by Deaf performers, as it better aligns with cultural responsiveness.

• Strengths and Comparisons:

  • Compared to non-Deaf performers, Deaf performers exhibit more natural and emotionally rich performances, with greater linguistic accuracy.
  • Non-Deaf performers often demonstrate better synchronization with musical timing but may lack emotional expression and cultural sensitivity.

• Experimental or Evaluation Results:

  • Both groups of participants agreed that collaborative improvements in signed song performances could provide culturally responsive and technically accurate content for a wider audience.
  • Participants expressed a desire for more assistive tools focused on lyric interpretation, emotion recognition, and rhythm assessment.

• Limitations and Future Directions:

  • Most participants in this study were d/Deaf individuals using hearing aids or cochlear implants, potentially limiting insights into the musical experiences of those who are profoundly deaf without assistive devices.
  • Further exploration is needed into collaboration methods within the Deaf community and between Deaf and hearing performers, particularly concerning cultural appropriation and rights distribution.

Design and Research Implications

1. Redefining Music Accessibility: Develop specialized tools based on d/Deaf individuals' prioritization of lyrics, rhythm, and emotional needs.
2. Cultural Respect and Identification: Include performer motivations and cultural identities on production platforms to promote transparency and cultural understanding.
3. Cross-Cultural Collaboration: Create socio-technical environments that facilitate collaboration between Deaf and hearing artists, supported by intuitive design tools addressing both technical and artistic needs.