"Think about it like you're a firefighter": Understanding How Reddit Moderators Use the Modqueue

Paper Title

'Think about it like you're a firefighter': Understanding How Reddit Moderators Use the Modqueue

Publication Info

• Topic area: Analysis of Reddit's moderation infrastructure and its impact on volunteer moderators' workflows.
• Keywords: Reddit, moderation, modqueue, community governance, socio-technical systems, volunteer moderation, interface design, automated systems, third-party tools, moderation workflows.

Background and Problem

• Problem / challenge: Despite the centrality of the modqueue in Reddit's moderation model, little is known about how moderators use it in practice, what challenges they face, and how its design shapes their workflows.
• Significance: Understanding modqueue usage is critical for improving moderation tools, ensuring effective governance, and supporting the sustainability of volunteer moderation on platforms like Reddit.
• Motivation and related work: Prior research has focused on content flagging and rule enforcement but has largely overlooked how moderators review flagged content. This study addresses the gap by examining how the modqueue mediates moderation practices and where it aligns or misaligns with moderators' needs.

Solution

• Proposed approach: A survey-based study of 110 Reddit moderators to analyze how they use the modqueue, their workflows, and the challenges they encounter.
• Novelty:
  1. First in-depth study of modqueue usage across multiple Reddit interfaces (Old Reddit, New Reddit, and mobile).
  2. Identification of diverse modqueue workflows, including checklist-style, pattern-recognition, and context-seeking approaches.
  3. Analysis of challenges such as coordination issues, fragmentation across tools, and reliance on third-party extensions.
  4. Design recommendations for modular, context-aware, and cross-interface moderation tools.
• Procedure and key techniques:
  • Surveyed 110 moderators from 400+ subreddits using structured and open-ended questions.
  • Analyzed responses using descriptive statistics and qualitative coding to identify patterns in modqueue usage, prioritization strategies, and challenges.
  • Contextualized findings with prior research on moderation tools and community governance.

Results

• Concrete findings:
  • 84% of moderators leave the modqueue to gather additional context, such as user history or broader conversation threads.
  • 74.5% reported experiencing collisions (simultaneous actions by multiple mods on the same item).
  • Moderators use diverse prioritization strategies, including sequential traversal, sorting by report type, and adaptive multi-step workflows.
  • Fragmentation across Old Reddit, New Reddit, and mobile interfaces, combined with reliance on third-party tools, disrupts workflows and creates inefficiencies.
• Advantage over baselines: Provides the first empirical account of modqueue usage, highlighting gaps in existing tools and opportunities for improvement that align with moderators' values and workflows.
• Experiments / evaluation:
  • Surveyed moderators with varying experience levels (1–20+ years) and weekly workloads (1–20+ hours).
  • Represented subreddits of diverse sizes (10,000–100,000+ members) and topics.
  • Analyzed both structured and open-ended survey responses to capture quantitative patterns and qualitative insights.
• Limitations and future work:
  • Limited depth in survey responses; follow-up interviews could provide richer insights.
  • Self-reported workflows may not fully reflect actual practices.
  • Difficulty in isolating interface-specific effects due to mixed usage of Old Reddit, New Reddit, and mobile.
  • Future work could explore moderators' values more explicitly and examine the impact of specific interface features on workflows.

Summary

This study investigates how Reddit moderators use the modqueue, revealing its role as a flexible but fragmented infrastructure for reviewing flagged content. Moderators employ diverse workflows, from checklist-style processing to pattern-recognition strategies, often leaving the modqueue to gather additional context or coordinate with teammates. Challenges include coordination issues, inadequate contextual signals, and reliance on third-party tools that may break with platform updates. The findings highlight the need for modular, context-aware, and cross-interface tools that align with moderators' values and workflows. These insights have broader implications for designing sustainable, community-reliant moderation systems on Reddit and similar platforms.