Compete, Collaborate, Investigate: Exploring the Social Structures of Open Source Intelligence Investigations

Title of the Paper

Compete, Collaborate, Investigate: Exploring the Social Structures of Open Source Intelligence Investigations

Paper Information

• Subject Area: Social structures and investigative practices within the Open Source Intelligence (OSINT) community
• Keywords: Open Source Intelligence, OSINT, investigation, collaboration, competition, crowdsourcing, community practices, social computing, tool design

Research Background and Issues

• Identified Problems or Challenges:

  • Online investigations are increasingly conducted by individuals with varying skill levels and experience, leading to inconsistent results. Novice investigations may cause online harassment or misidentification, while expert investigations have higher success rates and significantly fewer errors.
  • The potential of Open Source Intelligence (OSINT) across various application domains continues to grow, but the social dynamics of its community and the social tactics involved in investigations remain underexplored.
  • Crowdsourced investigations dominated by novice participants face bottleneck issues that have not been adequately addressed.

• Significance:

  • OSINT is increasingly applied in areas such as national security, human rights advocacy, and crisis response, carrying significant societal impact. However, its community practice models and social structures remain unclear, and research is urgently needed on training mechanisms for novices and collaboration methods for experts to improve efficiency and mitigate ethical concerns.
  • In-depth research can contribute to improving interdisciplinary collaboration and tool design, thereby fostering the success of the OSINT community.

• Research Motivation and Related Work:

  • The research is motivated by an interest in the social dynamics of OSINT (particularly collaboration and competition models) and the improvement of tools and technical challenges in the field.
  • Related research has extended the tools and technical methods of OSINT, but examinations of its social and organizational structures remain insufficient.

Solution

• Methods or Solutions: Conducted semi-structured interviews with 14 OSINT experts to study the social structures and dynamics within the OSINT community. The research focuses on the following questions:

  1. What are the motivations, attitudes, and definitions of success for organizers and contributors in OSINT investigations?
  2. How do organizers plan and structure OSINT investigations? What challenges do they face, and how do they overcome them?

• Innovations:

  • Defined and described "social OSINT tactics" (strategies combining competition and collaboration), adding depth to related research.
  • Connected the dynamics of collaboration and competition to the social practices of OSINT investigations from the perspectives of HCI and CSCW research.
  • Proposed tool design recommendations to support OSINT investigations, integrating them with social computing systems for crowdsourced investigations.

• Implementation Steps and Techniques:

  1. Interviewed OSINT experts from various organizations and social frameworks, including competitive (e.g., Capture The Flag, CTF) and collaborative investigations.
  2. Applied thematic analysis to the interview data, summarizing 44 in-depth codes and 1,207 excerpts.
  3. Analyzed core factors and challenges in the OSINT community, including ethics, transparency, technology use, and social support networks.

Research Outcomes

• Specific Findings:

  1. Characteristics of the OSINT Community:
     • Culture of transparency: Use of publicly accessible data, with all sources and verification processes documented.
     • Adversarial thinking: Efficiency and quality of investigations are enhanced through simulated adversarial and competitive methods.
     • Collaborative culture: Broad skill-sharing and cross-disciplinary integration are key to improving investigative effectiveness.
  2. Social OSINT Tactics:
     • Use of small team collaboration tactics in competitive environments, such as the CTF team collaboration of O7.
     • Introduction of adversarial thinking (e.g., red-teaming) in collaborative environments to avoid group blind spots.
  3. Tool Design Recommendations:
     • Develop a multi-user collaborative case management platform to support all stages of investigations.
     • Provide technical interoperability standards to improve data flow efficiency.
     • Leverage social networks (e.g., Twitter) to facilitate real-time crowdsourced tasks.

• Comparison with Existing Solutions and Advantages:

  • Compared to research focusing on tool design, this study enriches the understanding of the OSINT community through a social dynamics perspective.
  • The proposed tool recommendations optimize the existing OSINT tool ecosystem, emphasizing user adaptability and information transparency.

• Experimental or Evaluation Results:

  • Analysis of participant interviews revealed the social structures and dynamic characteristics of OSINT investigations, supported by specific experiences.

• Limitations and Future Directions:

  • Limitations include insufficient representation of global cultural/gender diversity (most samples were North American males).
  • Future research could expand to study OSINT dynamics in different cultural contexts and develop new functionalities for tools in practical applications.