helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Can onomatopoeia improve deaf and hard-of-hearing people's perception of non-speech sounds?Direction: Accessibility and Assistive Technology
Captions, Speech Transcription, and Deaf Communication Assistance
Stats are based on currently indexed question data; missing sources remain visible.
44
items
11
sources
2025
latest
All questions
44 items
helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Do deaf and hard-of-hearing people prefer captions in 'category + onomatopoeia' form for non-speech sounds?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Do generated onomatopoeia captions have sufficient naturalness and expressiveness?lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
DHH people cannot fully perceive sound details and emotional atmosphere in videos through existing captions.helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How can deaf and hard-of-hearing users effectively access speech and non-speech information in VR multiplayer interaction?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How can caption systems balance readability, information delivery efficiency, and cognitive burden?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
What are best practices for caption design supporting deaf and hard-of-hearing users in VR multiplayer interaction?lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Deaf and hard-of-hearing users struggle to access critical auditory information in VR and cannot participate equally in interaction.helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How can caption systems more effectively convey emotional information by combining visual and haptic modalities?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Which haptic feedback patterns best balance emotional conveyance and user comfort for deaf users?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Can visually and haptically enhanced captions significantly improve emotional understanding and immersion in video content?lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Deaf users struggle to perceive intensity and variation of emotions in videos from captions alone.helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How can real-time flowing speech be segmented word-by-word in time to generate accurate captions?UIST '24Real-Time Word-Level Temporal Segmentation in Streaming Speech Recognition
helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How do dynamic decorative captions such as font size and emphasis affect communication of intent?UIST '24Real-Time Word-Level Temporal Segmentation in Streaming Speech Recognition
helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Which methods can improve precision and response speed of real-time captioning systems?UIST '24Real-Time Word-Level Temporal Segmentation in Streaming Speech Recognition
lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Deaf users struggle to understand speech tone and emphasis through traditional captions.UIST '24Real-Time Word-Level Temporal Segmentation in Streaming Speech Recognition
helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How can AR integrating speech-to-text (STT) and text-to-speech (TTS) enable real-time bidirectional communication between deaf students and teachers and peers?CSCW '24Bridging Communication Gaps Using Augmented Reality: Designing a User Conversational Interface for Hearing Impaired Students
helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Can this user-centered conversational UI (CUI) effectively improve deaf students' classroom participation in low-resource educational environments?CSCW '24Bridging Communication Gaps Using Augmented Reality: Designing a User Conversational Interface for Hearing Impaired Students
helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
In AR environments, how can subtitle display and interaction be optimized to reduce external distraction and improve UX?CSCW '24Bridging Communication Gaps Using Augmented Reality: Designing a User Conversational Interface for Hearing Impaired Students
lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Deaf students struggle with real-time communication and effective learning in classrooms.CSCW '24Bridging Communication Gaps Using Augmented Reality: Designing a User Conversational Interface for Hearing Impaired Students
helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
What implementation trends exist for non-speech audio information (NSI) in YouTube captions?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How do different video types and producers affect NSI caption coverage and quality?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How can datasets and automated tools improve quality evaluation standards for NSI captions?lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Deaf users struggle to obtain complete video content from YouTube captions lacking non-speech information.helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Can existing subtitle quality metrics accurately reflect users' real subjective experience?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
What factors affect users' subjective assessment of live TV subtitle quality?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
What are the effects of synchrony, subtitle style, and design on subtitle usability and UX?lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Deaf people struggle to keep up with live TV content because subtitles are imprecise and lag behind.helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How can visualizing speech prosody (volume, pitch, and speed) improve captioning experience for Deaf and hard-of-hearing users?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How can visualizing emotional information (based on valence and arousal) improve expressiveness of captions in online meetings?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Do combined emotion and prosody caption models outperform traditional captions in expressing emotion and emphasis?lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Deaf and hard-of-hearing users struggle to obtain emotional and emphasis information from speech through traditional captions.helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
In groups with mixed hearing status, how are real-time captions influenced by members' social behavior and communication habits?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How can co-design improve real-time captioning in video conferencing tools to support accessibility for mixed-hearing groups?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Which specific features in video conferencing tools can improve communication effectiveness for mixed-hearing groups?lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Existing video conferencing tools struggle to meet accuracy and usability needs for real-time captions in mixed-hearing groups.helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
In real-time captions, how can audio-haptic interfaces improve speaker identification for deaf and hard-of-hearing users?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How much does haptic feedback improve speaker identification and information access efficiency in real-time captions?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
How do multimodal feedback combinations of haptics and vision help deaf and hard-of-hearing users better understand complex auditory environments?lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Deaf and hard-of-hearing users struggle to identify speakers through real-time captions, especially in multi-person interactions.helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
In online video conferencing, how does speechreading (lip-reading to understand speech) affect communication experience for deaf and hard-of-hearing people?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
What advantages and challenges arise from combining speechreading with captioning technology?helpResearch questionCaptions, Speech Transcription, and Deaf Communication Assistance
Which design supports can improve speechreading usability in online environments?lightbulbPractical problemCaptions, Speech Transcription, and Deaf Communication Assistance
Deaf and hard-of-hearing users struggle to fully express and receive information through existing technology in video conferencing.Related papers
CHI 2025
OnomaCap: Making Non-speech Sound Captions Accessible and Enjoyable through Onomatopoeic Sound Representation
JooYeong Kim, Jin-Hyuk Hong
CHI 2025
VRCaptions: Design Captions for DHH Users in Multiplayer Communication in VR
Tianze Xie, Xuesong Zhang, Feiyu Huang
CHI 2025
Tactile Emotions: Multimodal Affective Captioning with Haptics Improves Narrative Engagement for d/Deaf and Hard-of-Hearing Viewers
Caluã de Lacerda Pataca, Saad Hassan, Lloyd May
CHI 2024
Unspoken Sound: Identifying Trends in Non-Speech Audio Captioning on YouTube
Lloyd May, Keita Ohshiro, Khang Dang
CHI 2024
How Users Experience Closed Captions on Live Television: Quality Metrics Remain a Challenge
Mariana Arroyo Chavez, Molly Feanny, Matthew Seita
CHI 2023
Visualization of Speech Prosody and Emotion in Captions: Accessibility for Deaf and Hard-of-Hearing Users
Caluã de Lacerda Pataca, Matthew P Watkins, Roshan L. Peiris
CHI 2023
“Easier or Harder, Depending on Who the Hearing Person Is”: Codesigning Videoconferencing Tools for Small Groups with Mixed Hearing Status
Emma J McDonnell, Soo Hyun Moon, Lucy Jiang
CHI 2023
Haptic-Captioning: Using Audio-Haptic Interfaces to Enhance Speaker Indication in Real Time Captions for Deaf and Hard-of-Hearing Viewers
Yiwen Wang, Ziming Li, Pratheep Kumar Chelladurai
CHI 2023
Understanding and Enhancing the Role of Speechreading in Online d/DHH Communication Accessibility
Aashaka Desai, Jennifer Mankoff, Richard E. Ladner
Adjacent categories
Accessibility and Assistive Technology
Accessibility Support Needs and Design Pain Points
139 items
Accessibility and Assistive Technology
Chart, Image, and Visual Content Accessibility
117 items
Accessibility and Assistive Technology
Web and Community Content Accessibility
108 items
Accessibility and Assistive Technology
Spatial Navigation, Orientation, and Mobility Assistance
107 items
Accessibility and Assistive Technology
Tactile Graphics, 3D Printing, and Haptic Feedback
104 items
Accessibility and Assistive Technology
Blind and Low-Vision Accessibility
103 items
Accessibility and Assistive Technology
Autism and Neurodiversity Support
84 items
Accessibility and Assistive Technology
Sign Language Recognition and Sign Language Interaction
72 items