Research Products at Scale: Learnings from Designing Devices in Multiples of Ones, Tens, Hundreds and Thousands

Title of the Paper

Research Products at Scale: Learnings from Designing Devices in Multiples of Ones, Tens, Hundreds and Thousands

Paper Information

• Subject Area: Human-computer interaction design research on experiences and methods in production at different scales
• Keywords: design research, research through design, research products, DIY devices, Internet of Things

Research Background and Issues

• Problems or Challenges:

  • Traditional "research prototypes" fail to adequately describe the devices implemented in design research and cannot fully reflect the research characteristics of these devices.
  • The design, manufacturing, and deployment of research products at different scales (from single units to thousands) significantly impact research methods and participant engagement strategies.

• Significance:

  • Exploring the complex relationships between humans and technology through research products is a critical direction in the field of human-computer interaction.
  • The impact of scale on the lifecycle of research products highlights the potential of design research, enabling broader public engagement and fostering more diverse understanding and feedback.

• Research Motivation and Related Work:

  • Odom et al. (2016) proposed four key characteristics of research products: Inquiry, Finish, Fit, and Independence.
  • The authors of this paper add "Scale" as a fifth characteristic, emphasizing that scale influences the performance of the other four dimensions.
  • Drawing on 20 years of practice in a design research studio, the paper explores the evolution of research products in terms of scale and their methodological implications.

Solution

• Method:

  • Propose scale as one of the core characteristics of research products and analyze its impact on design, manufacturing, and participant feedback through the pathway from single units to small batches, large batches, and DIY approaches.
  • Summarize the design and scale effects of four case studies (Drift Table, Indoor Weather Stations, Datacatchers, My Naturewatch Camera).

• Innovations:

  • Expand the role of traditional research prototypes by placing research products within a new methodological framework.
  • Boldly experiment with scaled production to achieve broader public engagement and feedback.
  • Advance DIY research product methods, enabling non-experts to efficiently participate in digital fabrication and research projects.

• Implementation Steps and Key Techniques:

  • Single Research Product: Design and deploy high-finish devices, collect feedback through deep participatory methods and detailed observation of a single participant, e.g., Drift Table.
  • Low-Volume Production: Manufacture a limited number of devices (20 units) and collect diverse opinions through probe deployment, community websites, and visits, e.g., Indoor Weather Stations.
  • High-Volume Production: Design optimized devices for rapid mass production (130 units), recruit participants with external assistance, and collect feedback via documentary filming, e.g., Datacatchers.
  • DIY Approach: Design devices that anyone can make, promote through TV programs and online guides, and collect feedback via forums and social media, e.g., My Naturewatch Camera.

Research Outcomes

• Specific Outcomes:

  • Enriched the case library of research products from design and manufacturing to large-scale deployment.
  • Demonstrated the role of different scales in design, manufacturing, and deployment in data collection, diverse participant feedback, and public impact through four notable projects.

• Advantages Compared to Existing Solutions:

  • Adjusted design strategies by scale to meet specific goals: in-depth participatory feedback (single device) versus broad public engagement (DIY devices).
  • Combined handcrafted elements with modern digital fabrication technologies (e.g., 3D printing and PCB design) to enhance device independence and finish.

• Experimental or Evaluation Results:

  • Long-term use of the Drift Table demonstrated the impact and research value of single devices.
  • Indoor Weather Stations showcased the flexibility of low-volume production devices and innovative strategies for collecting diverse feedback.
  • The Datacatchers project successfully achieved high-volume device deployment, though documentary feedback revealed challenges in participant data quality.
  • My Naturewatch Camera motivated participation from over 3,000 users through the DIY approach, establishing a broad "non-expert" digital fabrication community.

• Limitations and Future Directions:

  • Single and small-batch production is more suitable for in-depth research, while high-volume and DIY methods lean towards broader impact but with reduced feedback depth.
  • Future work could explore strategies that combine feedback depth with scale expansion to foster closer connections between design research and the public.
  • Improve technologies and methods for building feedback communities to enhance feedback diversity and quality.

Conclusion

This paper develops a theoretical framework for research products, emphasizing the importance of scale as a core characteristic. Through four case studies, it deeply analyzes design strategies and outcome differences under varying scale conditions. This approach not only demonstrates the potential of research products to impact the public but also advances methodological standards in design research for diverse data collection and broad public engagement.