Jin-Hyuk Hong

schoolGwangju Institute of Science and Technologybar_chart#403 Global Rank

Total Papers

HCI Rank

#403

Research Areas

Years Active

Recent Publications

µCap: Instrumental Music Captions for Deaf and Hard-of-Hearing Individuals

Instrumental music conveys rich affective experiences through acoustic cues, yet instrumental passages often remain inaccessible to Deaf and Hard-of-Hearing (DHH) audiences. Although captioning practices for vocal songs have expanded, instrumental music remains largely uncaptioned, with no established criteria for rep…

CHI '26CorrespondingGenerative AI (Text, Image, Music, Video) +3

From Daily Song to Daily Self: Supporting Emotional Growth of Deaf and Hard-of-Hearing Individuals through Generative AI Songwriting

The rapid advancement of generative AI (GenAI) is expanding access to songwriting, offering a new medium of self-expression for Deaf and Hard-of-Hearing (DHH) individuals. However, emerging technologies that support DHH individuals in expressing themselves through music have largely been evaluated in single-session se…

CHI '26CorrespondingEye Tracking & Gaze Interaction +3

Understanding Gaze-Based Identification in VR Through Preattentive Processing and Binocular Rivalry

Stimulus-evoked gaze dynamics offer a secure and hands-free signal in virtual reality (VR), yet the underlying design space of effective visual stimuli remains poorly understood. This work examines how preattentive processing and binocular rivalry can inform stimulus design for gaze-based identification in VR. We cond…

CHI '26CorrespondingGenerative AI (Text, Image, Music, Video) +3

Designing a Generative AI-Assisted Music Psychotherapy Tool for Deaf and Hard-of-Hearing Individuals

Songwriting has long served as a powerful medium for expressing unconscious emotions and fostering self-awareness in psychotherapy. Due to the auditory-centric nature of traditional approaches, Deaf and Hard-of-Hearing (DHH) individuals have often been excluded from music’s therapeutic benefits. In response, this stud…

CHI '26CorrespondingIn-Vehicle Haptic, Audio & Multimodal Feedback +2

HumanoidTurk: Expanding VR Haptics with Humanoids for Driving Simulations

We explore how humanoid robots can be repurposed as haptic media, extending beyond their conventional role as social, assistive, collaborative agents. To illustrate this approach, we implemented HumanoidTurk, taking a first step toward a humanoid-based haptic system that translates in-game g-force signals into synchro…

CSCW '25CorrespondingDeaf and Hard-of-Hearing Research

Guaranteeing Equitable Musical Collaboration: Lessons Learned from the Music-Making Activities in Mixed-Hearing Groups

Integrating mixed-hearing groups in musical collaboration presents unique challenges and opportunities for their communication and equal contribution. This observational study aims to explore their collaborative work, focusing on the way for equitable music-making. We observed two music-making workshops to identify th…

CHI '25CorrespondingVoice Accessibility +2

OnomaCap: Making Non-speech Sound Captions Accessible and Enjoyable through Onomatopoeic Sound Representation

Non-speech sounds play an important role in setting the mood of a video and aiding comprehension. However, current non-speech sound captioning practices focus primarily on sound categories, which fails to provide a rich sound experience for d/Deaf and hard-of-hearing (DHH) viewers. Onomatopoeia, which succinctly captu…

CHI '25CorrespondingGenerative AI (Text, Image, Music, Video) +2

MVPrompt: Building Music-Visual Prompts for AI Artists to Craft Music Video Mise-en-scène

Music videos have traditionally been the domain of experts, but with text-to-video generative AI models, AI artists can now create them more easily. However, accurately reflecting the desired music-visual mise-en-scène remains challenging without specialized knowledge, highlighting the need for supportive tools. To ad…

CHI '25CorrespondingGenerative AI (Text, Image, Music, Video) +1

Understanding the Potentials and Limitations of Prompt-based Music Generative AI

Prompt-based music generative artificial intelligence (GenAI) offers an efficient way to engage in music creation through language. However, it faces limitations in conveying artistic intent with language alone, highlighting the need for more research on AI-creator interactions. This study evaluates three different in…

CHI '25CorrespondingAI-Assisted Decision-Making & Automation +2

BIASsist: Empowering News Readers via Bias Identification, Explanation, and Neutralization

Biased news articles can distort readers' perceptions by presenting information in a way that favors or disfavors a particular point of view. Subtly embedded in the text, these biased news articles can shape our views daily without people even realizing it. To address this issue, we propose BIASsist, an LLM-based appr…

View all 15 papers →

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/6818?source=all