From Concept to Community: Unpacking the Work of Designing Educational and Activist Toolkits

Title of the Paper

From Concept to Community: Unpacking the Work of Designing Educational and Activist Toolkits

Paper Information

• Subject Area: Human-Computer Interaction (HCI), Toolkit Design, Education, and Community Activism
• Keywords: Toolkit Design, Participatory Design, Deployment and Evaluation, Education, Social Activism, Modular Design, Community Building, Long-term Maintenance, Reflective Design, Social Computing

Research Background and Problems

• Identified Problems or Challenges:
  1. The potential of educational and activist toolkits to assist practitioners (e.g., librarians, teachers, community workers) in addressing sociotechnical issues has not been fully explored.
  2. The design and maintenance of toolkits are complex, involving significant social aspects that remain underexplored in academic research.
  3. The gap between the intended and actual use of toolkits, as well as how to design for diverse user needs, remains an open question.
• Significance of the Problem: Toolkits serve as bridges for knowledge transfer and practice, helping communities tackle critical societal issues such as misinformation, algorithmic fairness, and online harassment. However, poor design can limit their societal impact.
• Research Motivation and Related Work: By analyzing interviews with 20 designers, the authors summarize experiences and challenges across different stages of toolkit design, including the initial concept, imagined usage, user collaboration, and post-deployment maintenance. The goal is to deepen the understanding of toolkit design from both social and technical perspectives to enhance their impact.

Proposed Solution

• Proposed Methods or Solutions:

  • Utilizing narrative analysis combined with grounded theory to examine the "journeys" of designing 14 educational and activist toolkits.
  • Introducing a four-stage model of toolkit design: points of departure, conceptualizing use, user collaboration, and post-release maintenance and impact.
  • Providing three specific design case studies as narrative analyses and synthesizing common findings across all interviews.

• Innovative Aspects of the Solution:

  1. Highlighting the role of toolkits as sociotechnical systems rather than mere tools for knowledge dissemination.
  2. Exploring how designers' motivations and backgrounds shape toolkits and proposing "co-building user communities" as a design strategy.
  3. Identifying "sustainability," "adaptability," and "community co-creation" as key dimensions for toolkit design post-release.

• Implementation Steps and Key Techniques:

  1. Data Collection: Conducting semi-structured interviews with 20 designers of 14 toolkits.
  2. Data Analysis: Employing grounded theory for thematic analysis; organizing data using Miro and deepening insights through narrative methods.
  3. Case Selection: Choosing three toolkit design cases based on diverse dimensions such as "design scale," "team background," and "user collaboration models."

Research Findings

• Specific Findings:

  1. Identified four core stages of toolkit design:
     • Points of Departure: How designers' backgrounds, resources, and motivations influence toolkit design.
     • Conceptualizing Use: Making toolkits understandable and operable while supporting user adaptability.
     • User Collaboration: Enhancing user experience through participatory design, such as co-creating communities via design workshops.
     • Post-Release: Exploring issues of updates, sustained use, and maintenance.
  2. Provided in-depth narrative analyses of three toolkit design practices: "Community Issue Exhibition Toolkit," "ConnectedLib Toolkit," and "News & Media Literacy 101."
  3. Proposed key considerations for future toolkit design:
     • Maintenance and exit strategies for toolkits post-release.
     • Supporting creative adaptations and secondary development by users.
     • Reflective relationships between designers and communities.

• Comparison with Existing Solutions and Advantages:

  • Offers detailed narratives of toolkit design processes from the designers' internal perspectives, rather than solely external content analysis.
  • Emphasizes the importance of community building and long-term relationship development in toolkit design, beyond focusing on the toolkit itself.
  • Introduces new dimensions for managing the toolkit lifecycle, such as the "evergreening" strategy.

• Experimental or Evaluation Results: Explored which designs and methods among the 14 toolkits effectively promoted practitioner use, identifying "community co-creation" and "modular design" as widely recognized and practiced strategies.

• Limitations and Future Research Directions:

  1. The analysis predominantly focuses on English-speaking contexts, potentially overlooking design and usage patterns in non-Western cultures.
  2. Interviews are limited to designers' perspectives, lacking validation and longitudinal studies with actual users.
  3. Ethical issues and exit strategies in the relationship between toolkits and communities require further exploration.
  4. To address the "ambiguity of use" in toolkits, future research should develop more precise evaluation methods and tools.