Close-up and Whispering: An Understanding of Multimodal and Parasocial Interactions in YouTube ASMR videos
Authors
Digital Art Installations & Interactive PerformanceInteractive Narrative & Immersive StorytellingContent Creators (YouTubers, Podcasters)Musicians, DJs & Sound Designers
Title of the Paper
Close-up and Whispering: An Understanding of Multimodal and Parasocial Interactions in YouTube ASMR Videos
Paper Information
- Research Area: ASMR (Autonomous Sensory Meridian Response) and multimodal, parasocial experience studies in the field of HCI (Human-Computer Interaction)
- Keywords: ASMR, YouTube, videos, multimodal interaction, parasocial relationships, experience design, audio-visual design, psychological effects, viewer behavior
Research Background and Issues
-
Identified Problems or Challenges:
- The popularity of ASMR videos on YouTube has fostered deep connections between content creators and viewers. However, research in the HCI field on ASMR videos remains limited, hindering further development of related designs.
- Although studies suggest ASMR benefits mental health (e.g., reducing anxiety, improving sleep), large-scale quantitative research on different ASMR trigger mechanisms and experience patterns is lacking.
- ASMR trigger mechanisms are diverse, yet individual responses to the same trigger vary significantly. It is unclear whether commonly used patterns can meet the needs of a broader audience.
-
Importance of the Research:
- ASMR is a unique phenomenon combining audio, visual, tactile, and other multimodal experiences. Beyond entertainment, it is considered to promote relaxation and virtual intimacy. Understanding its multimodal interactions and "parasocial relationships" with viewers is crucial.
- Optimizing and popularizing ASMR-related designs (e.g., for online education, psychological therapy, remote social tools) can significantly enhance user experiences.
-
Motivation and Related Work:
- Existing studies primarily focus on small-sample analyses of trigger mechanisms, user surveys, or brain imaging, lacking large-scale data research covering different types of ASMR videos.
- Many studies emphasize "real trigger" role-playing videos in ASMR while neglecting analyses of non-task-oriented, background ASMR videos.
- Parasocial interaction theory highlights the importance of understanding how creators design social appeal and interactive experiences to build intimacy.
Solution
-
Proposed Approach:
- By analyzing 2,663 ASMR videos from YouTube and nearly 480,000 comments, the authors quantified the multimodal interactions (visual, auditory, tactile, gustatory, and situational simulation) and social appeal (social, physical proximity, task-oriented) of the videos.
- Using data annotation and statistical analysis methods, they summarized the correlation patterns between ASMR experience modes and viewers' emotional expressions.
-
Innovations:
- The study categorizes ASMR trigger mechanisms into multimodal interaction types, defining ASMR as a form of multimodal social experience and sensory observation rather than merely audio-visual entertainment.
- For the first time, it quantifies viewers' emotional responses (including intimacy, relaxation, and sensory perception) based on comments.
- It systematically discusses the potential implications of ASMR video design for technological applications, such as remote communication and psychological support tools.
-
Implementation Steps and Key Techniques:
- Data Collection:
- Using the YouTube Data API, the authors retrieved basic data for 227,133 videos, ultimately filtering 2,663 videos based on ASMR tags and English-language criteria.
- They collected 483,583 viewer comments related to these videos for emotional expression analysis.
- Data Annotation:
- Video content was annotated for multimodal features on the Amazon Mechanical Turk platform, with guidelines designed to evaluate ASMRtists' (ASMR creators) parasocial appeal strategies.
- Statistical Analysis:
- Pearson chi-square tests and least squares regression models (LSR) were employed to analyze the distribution of multimodal interactions and social appeal and their emotional correlations in comments.
- Data Collection:
Research Results
-
Main Findings:
- ASMR videos can be summarized into three experience modes:
- Multimodal Social Connection: 65% of videos feature creators mimicking face-to-face interactions with viewers; over 78% include whispering or soft-spoken sounds; most videos use hand gestures to touch the camera, creating a sense of interaction with viewers.
- Relaxing Physical Intimacy: 70% of videos employ close-up shots or sound/microphone triggers to simulate intimate interactions; comments frequently mention relaxation and sleep aid.
- Sensory Observation Activities: Over 70% of videos lack role-playing or tasks, focusing on repetitive sensory stimulation (e.g., tapping objects, sound creation).
- Parasocial appeal and multimodal interaction are highly correlated:
- ASMR videos with social appeal (e.g., role-playing, direct conversation) are more likely to elicit stronger emotional connections and intimacy.
- Different sound triggers (e.g., object sounds, whispering) significantly enhance sensory impressions and relaxation experiences.
- ASMR videos can be summarized into three experience modes:
-
Advantages and Contributions:
- Compared to previous small-sample ASMR studies, this paper uses large-scale data for comprehensive analysis, providing theoretical support for broader ASMR application design.
- Practically, the findings can improve the design of video-sharing platforms, online education, and mental health support tools to maximize user relaxation and emotional engagement.
-
Limitations and Future Directions:
- Limitations:
- The study only analyzes intentional ASMR videos explicitly labeled "ASMR," excluding many videos that may unintentionally trigger ASMR.
- It relies solely on comments rather than interviews, potentially missing deeper insights into viewers' internal reactions.
- Future Directions:
- Extend the analysis to non-English or cross-cultural ASMR videos to achieve broader cross-cultural understanding.
- Compare the physiological and psychological effects of intentional and unintentional ASMR videos.
- Explore how ASMR effects can be integrated with technology in scenarios for anxiety, loneliness, or special populations (e.g., individuals with social disorders).
- Limitations:
Research Questions / Practical Problems
Question signals indexed for this paper.
help
Research Questions
3- How do multimodal interactions (e.g., visual, auditory, and tactile) in ASMR videos relate to viewers' emotional responses?Category: Psychological Interventions via Specific Therapy Modalities (ASMR, Binaural Beats, Meditation, Games)Similar questionsarrow_forward
- In ASMR content, what types of parasocial attraction contribute most to viewers' intimacy and relaxation?Category: Psychological Interventions via Specific Therapy Modalities (ASMR, Binaural Beats, Meditation, Games)Similar questionsarrow_forward
- How do different modes of ASMR experience affect their design potential as mental health or social tools?Category: Psychological Interventions via Specific Therapy Modalities (ASMR, Binaural Beats, Meditation, Games)Similar questionsarrow_forward
lightbulb
Practical Problems
1- Many users rely on ASMR for relaxation and mood improvement, but existing content cannot meet everyone's needs.Category: Psychological Interventions via Specific Therapy Modalities (ASMR, Binaural Beats, Meditation, Games)Similar questionsarrow_forward
- 80%
Producing Liveness: The Trials of Moving Folk Clubs Online During the Global Pandemic
CHI '21· Digital Art Installations & Interactive Performance +1
- 60%
Designing the Audience Journey through Repeated Experiences
CHI '18· Digital Art Installations & Interactive Performance +1
- 60%
Remote Rhythms: Audience-Informed Insights for Designing Remote Music Performances
DIS '24· Digital Art Installations & Interactive Performance +1
Based on Jaccard similarity of research subtopics & professions (≥60%)
Quick Actions
AdRecommended
Learn AI Coding at CodeNow
open_in_newOpen DOI Link
DOI: https://dl.acm.org/doi/abs/10.1145/3491102.3517563
At a Glance
fact_checkPaper Snapshot
dataset
Source
CHI
calendar_month
Year
2022
emoji_events
Award
No award tagged
group
Authors
5 authors
sell
Subtopics
Digital Art Installations & Interactive Performance, Interactive Narrative & Immersive Storytelling
work
Professions
Content Creators (YouTubers, Podcasters), Musicians, DJs & Sound Designers
article
Content Status
Full text indexed
hub
Related Papers
3 related papers