Assessing Mapper Conflict in OpenStreetMap Using the Delphi Survey Method

Document Title

Assessing Mapper Conflict in OpenStreetMap Using the Delphi Survey Method

Document Information

• Subject Area: Examining user conflicts and management methods within the OpenStreetMap (OSM) open data production community
• Keywords: Mapper conflict, OpenStreetMap, Delphi survey, crowdsourcing, conflict management

Research Background and Problem

• Identified Problems or Challenges:

  • A large and diverse group of contributors may encounter conflicts during collaborative data production, ranging from semantic definitions to data standardization issues.
  • These conflicts can impact data quality, community member retention, and the overall community atmosphere. However, there is a lack of in-depth research analyzing conflicts among OSM contributors and their management methods.

• Why This Problem Is Important:

  • Mapper conflicts not only directly affect data quality but also undermine community participation and trust, posing challenges to community governance.
  • Existing conflict management methods focus on data quality management while neglecting the root causes of conflicts.

• Research Motivation and Related Work:

  • The authors aim to understand the detailed characteristics of conflicts within the OSM community and explore the potential of designing improved communication platforms to manage these conflicts.
  • Literature indicates that conflicts in similar open communities (e.g., Wikipedia, GitHub) exhibit comparable characteristics, but their specific manifestations and solutions in OSM may have unique requirements.

Solution

• Proposed Method:

  • Employ the Delphi survey method, conducting multiple rounds of anonymous surveys to gather OSM contributors' perceptions and experiences regarding conflicts.
  • Utilize the first step of the conflict management theoretical framework—conflict diagnosis—to structurally analyze community conflicts through four core questions (conflict topics, causes, impacts, and management methods).

• Innovative Aspects:

  • Systematically applying conflict management theory to an open data production community for the first time, extracting design guidelines through questionnaire analysis.
  • Combining the Delphi survey method with the conflict management framework to uncover community complexities and provide consensus-based action directions.

• Implementation Steps and Key Techniques:

  1. Questionnaire Design: Initial questions focus on four core areas: conflict topics, causes, impacts, and management methods.
  2. Data Collection and Analysis:
     • Round 1: Open-ended qualitative responses to gather preliminary concepts.
     • Round 2: Consensus voting to identify key conflict areas (using a 5-point Likert scale).
     • Round 3: Ranking the consensus items from Round 2 based on importance.
  3. Sample Selection: Recruit participants from experienced OSM users and those in management roles.
  4. Analysis Tools: Summarize qualitative data, integrate cross-reviews and statistical metrics, and progressively refine conflict sources and solutions.

Research Outcomes

• Specific Findings:

  • Conflict Topics: Identified 14 major conflict areas, including tag definitions, boundary disputes, organized editing, and contributor background differences.
  • Conflict Causes: Key causes include diverse backgrounds (cultural and value differences), uncooperative behaviors during interactions, and fragmented "group opposition."
  • Conflict Impacts: Mostly negative, such as contributors leaving the community, declining trust within the community, and increased fragmentation; only a few positive effects (e.g., enhanced understanding of differences).
  • Management Recommendations: Emphasize the importance of establishing clear operational procedures and promoting cooperative interaction behaviors, with specific suggestions such as improving transparency, enhancing procedural clarity, and providing behavioral guidelines.

• Advantages Over Existing Solutions:

  • Offers a more comprehensive conflict diagnosis perspective, identifying conflict management needs specific to OSM rather than focusing solely on data quality issues.
  • The Delphi method encourages participant reflection and collaboration, fostering the development of more inclusive design solutions.

• Experimental or Evaluation Results:

  • The third-round survey revealed that organized editing, tag definitions, and the value assessment of diverse participants are the most critical conflict areas to address.
  • Setting higher shared goals and fostering more mature interaction behaviors were identified as the highest-priority management methods.

• Limitations and Future Directions:

  • Limitations:
    • The survey sample is biased toward experienced users, lacking representativeness.
    • The COVID-19 pandemic led to participant attrition, potentially limiting the generalizability of the results.
  • Future Directions:
    • Expand the study to include regular users and minority groups to address research gaps.
    • Subsequent research will explore optimizing human-computer interaction design to further improve conflict management tools and interfaces.