Towards Youth-Sensitive Hateful Content Reporting: An Inclusive Focus Group Study in Germany

Honorable Mention
Sleep & Stress MonitoringOnline Harassment & Counter-ToolsInclusive DesignSocial Workers

Research Background and Issues

  • What problems or challenges did the authors identify?
    Adolescents are frequently exposed to hateful content on social media, which can severely impact their mental health. However, most teenagers do not effectively utilize existing reporting mechanisms, including in-platform and independent reporting tools. In Germany, despite legal mandates against hate speech, many young people have never reported issues to law enforcement agencies or independent reporting centers. While research in the field of human-computer interaction has explored adults' perspectives on in-platform reporting, there is limited research on teenagers' views and alternative reporting mechanisms outside platforms.

  • Why is this issue important?
    Exposure to hateful content can lead to psychological distress, including anxiety, fear, insecurity, and sleep disturbances. Although adolescents appear more willing to take action, they still face numerous barriers. Understanding these barriers and designing reporting tools tailored to teenagers is critical for better protecting this vulnerable group.

  • Research Motivation and Related Work
    Previous studies have highlighted that individual characteristics (e.g., media literacy) and social environments influence adolescents' reporting behavior. Additionally, many platforms are inefficient in handling reports. While challenges faced by adult users in reporting mechanisms have been studied, the needs of teenagers regarding reporting systems remain unexplored. This work aims to fill this research gap, focusing on the barriers and design requirements for German teenagers in reporting hateful content.


Solutions

  • What methods or solutions did the authors propose?
    The authors conducted eight focus group interviews with 47 German adolescents and young adults to explore barriers to reporting hateful content and identify potential design requirements for youth-sensitive solutions. They further proposed a set of design guidelines to inform the development of more inclusive reporting systems.

  • What is innovative about this solution?
    This study is the first to deeply investigate teenagers' needs for the design of reporting tools outside platforms while systematically analyzing barriers to both in-platform and external reporting. Additionally, the five proposed design guidelines are broadly applicable to both types of reporting systems, providing a foundation for future design efforts.

  • What are the implementation steps and key technologies used?
    The study followed these steps:

    1. Conducted focus group interviews with young participants to explore their reporting experiences, barriers, and needs.
    2. Performed structured qualitative content analysis, using coding to identify specific barriers and requirements.
    3. Synthesized findings with existing literature to derive five design guidelines.
    4. Provided recommendations for improving existing tools, such as simplifying designs and adding feedback mechanisms.

Research Outcomes

  • What specific findings were achieved?
    The study identified:

    • Nine barriers: Adolescents perceived issues such as inadequate rule enforcement, lack of feedback, and limited categorization in platform reporting. For external reporting tools, they cited lack of awareness, complex processes, the need to leave social media platforms, and distrust in law enforcement agencies.
    • Eleven design requirements: These include core features such as process simplification, anonymous reporting, language support, customizable feedback, and psychological support.
  • What advantages does it have over existing solutions?
    The study highlights how current tools fail to meet the specific needs of teenagers and provides concrete recommendations for improvement. Compared to research focused on adult perspectives, this study emphasizes teenagers' actual experiences with reporting tools and proposes solutions that balance efficiency with user-friendliness.

  • What were the experimental or evaluation results?
    In the focus group interviews, most participants expressed that existing tools did not meet their needs and voiced skepticism toward law enforcement agencies and platform operators. They preferred tools that are simple, easy to use, and ensure privacy.

  • Limitations and Future Directions
    Limitations:

    • The sample was limited to teenagers from an urban area in Germany, which may not represent adolescents from rural areas or other countries.
    • The study did not explore the needs of other stakeholders, such as law enforcement agencies or reporting centers.

    Future Directions:

    • Expand research to include more countries and cultural contexts.
    • Employ more systematic participatory design methods to explore value conflicts among different stakeholders.
    • Investigate the deployment and evaluation of customized reporting systems for reducing hateful content.

Through this study, the authors identified key factors that hinder adolescents from reporting hateful content and proposed design guidelines to develop reporting systems better suited to young users. This work not only addresses a research gap but also provides valuable practical recommendations for policymakers, platform operators, and technology designers.

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/papers/chi/189287/2025

AdRecommended

Learn AI Coding at CodeNow

open_in_newOpen DOI Link
DOI: https://dl.acm.org/doi/10.1145/3706598.3713542
At a Glance

Paper Snapshot

fact_check
dataset
Source
CHI
calendar_month
Year
2025
emoji_events
Award
Honorable Mention
group
Authors
4 authors
sell
Subtopics
Sleep & Stress Monitoring, Online Harassment & Counter-Tools, Inclusive Design
work
Professions
Social Workers
article
Content Status
Full text indexed
hub
Related Papers
0 related papers