Why Creators Break Rules: Quantitative Evidence on Moral Disengagement and Self-Control

Paper Title

Why Creators Break Rules: Quantitative Evidence on Moral Disengagement and Self-Control

Publication Info

• Topic area: Psychological factors influencing noncompliant behavior and moderation experiences of social video creators.
• Keywords: Content moderation, moral disengagement, self-control, noncompliance, video creators, coping strategies, income reliance, fairness perception, restorative justice.

Background and Problem

• Problem / challenge: Current content moderation systems focus heavily on penalizing noncompliant content but neglect the psychological factors driving creators to offend and their post-moderation behaviors. This limits the effectiveness of moderation systems in promoting behavioral improvement.
• Significance: Understanding the psychological mechanisms behind noncompliance can inform the design of moderation systems that better support creators in reducing recidivism and improving compliance.
• Motivation and related work: While prior research has explored automated detection of harmful content and moderation logistics, little attention has been given to offenders' psychological processes. Theories of self-control and moral disengagement, widely used in criminology and organizational misconduct research, provide a framework for examining these processes in the context of content creation.

Solution

• Proposed approach: The study investigates how self-control and moral disengagement influence creators’ production of noncompliant content, their moderation experiences, and their post-moderation perceptions and coping strategies. It also examines the moderating role of income reliance.
• Novelty:
  1. Extends self-control and moral disengagement theories to content moderation contexts.
  2. Explores post-moderation behaviors, including fairness perceptions and coping strategies.
  3. Investigates income reliance as a moderator of psychological effects on noncompliance and coping.
• Procedure and key techniques:
  • Conducted an online survey with 400 video creators.
  • Measured self-control, moral disengagement, income reliance, noncompliant video creation, moderation experiences, fairness perceptions, and coping strategies.
  • Analyzed data using Structural Equation Modeling (SEM) to test hypotheses about direct and moderated effects.

Results

• Concrete findings:
  • Moral disengagement is positively associated with noncompliant video creation (β = 0.284, p < 0.001) and moderation experience (β = 0.427, p < 0.001).
  • Self-control is negatively associated with noncompliant video creation (β = -0.300, p < 0.001) and moderation experience (β = -0.190, p < 0.01).
  • Income reliance is positively associated with noncompliant video creation (β = 0.157, p < 0.05) and moderation experience (β = 0.223, p < 0.001).
  • Self-control promotes constructive coping strategies (e.g., problem-solving, positivity) but not detachment.
  • Moral disengagement is linked to avoidant coping strategies (e.g., detachment, wishful thinking).
• Advantage over baselines:
  • Provides a psychological explanation for noncompliance and post-moderation behaviors, going beyond rule clarification or punitive measures.
  • Identifies income reliance as a stakes amplifier, influencing both noncompliance and post-moderation engagement.
• Experiments / evaluation:
  • Surveyed 400 creators across multiple platforms, with 63.75% reporting moderation experiences.
  • Used validated scales and self-developed measures for constructs like noncompliant video creation and moderation experience.
  • Controlled for demographic variables and platform usage in SEM analyses.
• Limitations and future work:
  • Relied on self-reported data, which may underreport noncompliance due to social desirability bias.
  • Aggregated all forms of noncompliance into a single category, limiting insights into specific behaviors.
  • Did not verify creator status through external validation (e.g., account links).
  • Future work should explore frequency/severity of noncompliance, platform-specific policies, and monetization structures.

Summary

This study examines the psychological factors driving noncompliant behavior and post-moderation responses among social video creators. It finds that moral disengagement increases noncompliance and avoidant coping, while self-control reduces noncompliance and promotes constructive coping. Income reliance amplifies both risk-taking during content creation and engagement with moderation systems post-punishment. These findings extend self-control and moral disengagement theories to content moderation and highlight the need for restorative approaches that address psychological drivers of noncompliance. The study provides actionable insights for designing moderation systems that support behavioral improvement and compliance.