On the Making of Alternative Data Encounters: The Odd Interpreters

Document Title

On the Making of Alternative Data Encounters: The Odd Interpreters

Document Information

• Field of Study: Human-Computer Interaction (HCI), Data Visualization and Physicalization, Internet of Things (IoT), Design Research
• Keywords: Data, Data Physicalization, Household, Interpretation, IoT, Speculative Design, Research-through-Design (RtD)

Research Background and Problem Statement

• Identified Issues or Challenges:

  • Data collected and processed by IoT systems is often invisible and abstract in people's daily lives.
  • Current IoT system user interfaces are constrained by commercially driven, technology-oriented designs that emphasize productivity and objectivity, neglecting localization, interpretability, and dynamism of data.
  • Data interactions frequently overlook the deeper social contexts and subjective positioning of data.

• Significance of the Problem:

  • IoT data is increasingly embedded in daily life, yet its functionality remains limited to a productivity tool perspective. Exploring diverse interaction methods for future IoT data is crucial for enhancing user data awareness, privacy consciousness, and fostering application innovation.

• Research Motivation and Related Work:

  • Responding to calls in HCI and design research to emphasize diversity in data interactions (e.g., the concept of "Difraction-in-Action").
  • Drawing inspiration from data physicalization and contextualization (e.g., the invisible labor and materiality behind data infrastructures).
  • Transforming user interaction with household data from productivity-centered approaches to open-ended, experiential, and concrete directions.

Solution

• Proposed Solution:

  • The authors developed three design prototypes named Odd Interpreters (OIs) using a "Research-through-Design" (RtD) methodology:
    1. Broadcast: Presents the dynamics and geographical location of IoT data transmission through sound.
    2. Soft Fading: Uses fabric fading to record sunlight as a metaphor for data capture.
    3. Data Bakery: Converts smart plug data into cookie recipes, allowing users to experience the meaning of data through manual baking.

• Innovative Aspects of the Solution:

  • Introduces tangible, materialized, and multi-sensory interaction methods to make invisible IoT data experiential and concrete.
  • Emphasizes "abnormality" in design thinking, critiquing the overemphasis on productivity in current data interactions while highlighting user awareness of infrastructure and hidden labor.
  • Incorporates subjectivity and uncertainty into design, using artistic and experimental approaches to build relationships with data.

• Implementation Steps and Key Technologies:

  1. Broadcast:
     • Designed an acoustic device using Raspberry Pi and knobs.
     • Data capture functionality analyzes network packets transmitted by smart speakers at home.
     • Sounds are pre-recorded but triggered based on real network traffic scenarios.
  2. Soft Fading:
     • Utilizes hand-dyed fabric that fades under sunlight exposure to record data.
     • Fabric is connected to a rotating axis to complete daily automatic rotation.
  3. Data Bakery:
     • Uses IFTTT and Google Sheets to record smart plug on/off data.
     • Data is converted into cookie recipes, with manual intervention by designers to transform data into printed recipes.

Research Outcomes

• Specific Outcomes:

  • Developed three prototypes showcasing the diversity of data interaction methods: "Broadcast" highlights the global metaphor of data flow; "Soft Fading" emphasizes the locality and ambiguity of data collection; "Data Bakery" reveals human labor and social connections behind technology.
  • Videos and interviews supported the feasibility of the three designs and revealed the experiences brought by different prototypes.

• Comparative Advantages with Existing Solutions:

  • Unlike traditional chart-based and dashboard-style data representations, these prototypes express IoT data localization and diversity through materiality and concretization.
  • Reduces the singular emphasis on technical efficiency and objectivity, incorporating artistic and imaginative elements to expand users' perception of IoT data.

• Experimental or Evaluation Results:

  • Residential testing revealed that users' imagination of data meanings was activated when using the prototypes.
  • Noisy WiFi signal environments and device complexity highlighted technical and social challenges in IoT data interactions.

• Limitations and Future Directions:

  • Limitations include testing environments primarily restricted to the research team, with a small sample size.
  • Future research will expand prototypes to more household environments and deepen exploration of IoT data's non-neutral roles.
  • Investigate the relationships between data privacy, hidden labor, and structural user perceptions.