Dhruv Jain

schoolUniversity of Michiganbar_chart#816 Global Rank

Total Papers

HCI Rank

#816

Research Areas

Years Active

Recent Publications

RAVEN: Realtime Accessibility in Virtual ENvironments for Blind and Low-Vision People

As virtual 3D environments become more prevalent, equitable access is essential for blind and low-vision (BLV) users, who face challenges with spatial awareness, navigation, and interaction. Prior work has explored supplementing visual information with auditory or haptic modalities, but these methods are static and of…

CHI '25CorrespondingVoice Accessibility +2

Weaving Sound Information to Support Real-Time Sensemaking of Auditory Environments: Co-Designing with a DHH User

Current AI sound awareness systems can provide deaf and hard of hearing people with information about sounds, including discrete sound sources and transcriptions. However, synthesizing AI outputs based on DHH people’s ever-changing intents in complex auditory environments remains a challenge. In this paper, we describ…

CHI '24CorrespondingElectrical Muscle Stimulation (EMS) +2

Show, Not Tell: A Human-AI Collaborative Approach for Designing Sound Awareness Systems

Current sound recognition systems for deaf and hard of hearing (DHH) people identify sound sources or discrete events. However, these systems do not distinguish similar sounding events (e.g., a patient monitor beep vs. a microwave beep). In this paper, we introduce HACS, a novel futuristic approach to designing human-…

CHI '221st AuthorDeaf & Hard-of-Hearing Support (Captions, Sign Language, Vibration) +1

ProtoSound: A Personalized and Scalable Sound Recognition System for Deaf and Hard-of-Hearing Users

Recent advances have enabled automatic sound recognition systems for deaf and hard of hearing (DHH) users on mobile devices. However, these tools use pre-trained, generic sound recognition models, which do not meet the diverse needs of DHH users. We introduce ProtoSound, an interactive system for customizing sound rec…

DIS '211st AuthorSocial & Collaborative VR +2

A Taxonomy of Sounds in Virtual Reality

Virtual reality (VR) leverages human sight, hearing and touch senses to convey virtual experiences. For d/Deaf and hard of hearing (DHH) people, information conveyed through sound may not be accessible. To help with future design of accessible VR sound representations for DHH users, this paper contributes a consistent…

CHI '213rd AuthorHonorable MentionVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille) +3

What Do We Mean by "Accessibility Research"? A Systematic Review of Accessibility Papers in CHI and ASSETS from 1994 to 2019

Accessibility research has grown substantially in the past few decades, yet there has been no literature review of the field. To understand current and historical trends, we created and analyzed a dataset of accessibility papers appearing at CHI and ASSETS since ASSETS' founding in 1994. We qualitatively coded areas o…

CHI '204th AuthorDeaf & Hard-of-Hearing Support (Captions, Sign Language, Vibration) +1

Evaluating Smartwatch-based Sound Feedback for Deaf and Hard-of-hearing Users Across Contexts

We present a qualitative study with 16 deaf and hard of hearing (DHH) participants examining reactions to smartwatch-based visual + haptic sound feedback designs. In Part 1, we conducted a Wizard-of-Oz (WoZ) evaluation of three smartwatch feedback techniques (visual alone, visual + simple vibration, and visual + tacto…

CHI '201st AuthorDeaf & Hard-of-Hearing Support (Captions, Sign Language, Vibration) +1

HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users

We introduce HomeSound, an in-home sound awareness system for Deaf and hard of hearing (DHH) users. Similar to the Echo Show or Nest Hub, HomeSound consists of a microphone and display, and uses multiple devices installed in each home. We iteratively developed two prototypes, both of which sense and visualize sound in…

CHI '191st AuthorDeaf & Hard-of-Hearing Support (Captions, Sign Language, Vibration) +1

Exploring Sound Awareness in the Home for People who are Deaf or Hard of Hearing

The home is filled with a rich diversity of sounds from mundane beeps and whirs to dog barks and children's shouts. In this paper, we examine how deaf and hard of hearing (DHH) people think about and relate to sounds in the home, solicit feedback and reactions to initial domestic sound awareness systems, and explore p…

CHI '193rd AuthorHaptic Wearables +1

Deaf and Hard-of-hearing Individuals' Preferences for Wearable and Mobile Sound Awareness Technologies

To investigate preferences for mobile and wearable sound awareness systems, we conducted an online survey with 201 DHH participants. The survey explores how demographic factors affect perceptions of sound awareness technologies, gauges interest in specific sounds and sound characteristics, solicits reactions to three…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/13142?source=all