Stills from the Inner Ear Shorts: Collecting and Living with Data

Research Background and Problem

• Problem and Challenges: The authors point out that in the current data-driven economy and big data-dominated societal structure, data collection is often opaque, and personal data is frequently used for surveillance and commercialization. Smart devices (e.g., home cameras and voice assistants) covertly collect data and lack direct interaction with users. They obscure the processes of data generation and meaning-making.
• Significance: This asymmetry in the relationship between data and users undermines the privacy, freedom, and understanding of data by its owners. Redefining the relationship between individuals and data, and exploring the integration of data with memory, tactility, and spatial meaning, holds significant value for improving data cognition.
• Research Motivation and Related Work:
  • Related studies suggest that data physicalization is a promising approach to enable users to "touch" their data through materialization and multisensory interaction.
  • This project builds on existing research, such as designing home devices with data visualization features (e.g., Indoor Weather Stations) and narrative data tools (e.g., Data Epics), aiming to focus more on the essence of data and its interaction with physical space.

Solution

• Method Overview: The authors designed a device called "Inner Ear," a porcelain object that captures vibration data from the home environment and transforms it into a tactile, perceivable, physicalized data artwork.
• Innovations:
  1. Transforming vibration data into ceramic data rings, breaking away from traditional linear interpretations of data visualization and emphasizing the tactile and aesthetic experience of data.
  2. The device integrates art, design, and sensing technology, with its dual states of "data capture" and "data presentation" inviting user participation and reflection.
  3. Introducing a blurred and ambiguous approach to data construction, making the meaning of data more open to interpretation.
• Key Technologies and Implementation Steps:
  1. Data Collection: Inner Ear uses built-in sensors to collect vibration data within a 15-minute timeframe, allowing users to actively decide when to activate the collection.
  2. Data Translation: The collected data is transformed into 3D-printed ceramic rings using a differential growth algorithm.
  3. Data Physicalization: The data rings are manually attached to the device body, presented as sculptural objects.
  4. Participant Study: The research team deployed six Inner Ear devices in six households and analyzed user experiences and reactions through recorded short films and interviews.

Research Findings

• Specific Findings:
  1. Participants re-examined the vibrations in their daily environments through Inner Ear and developed new perceptions of space and activities.
  2. Participants reported being more open to multi-layered interpretations of data, rather than relying solely on direct readability, after experiencing the blurred and opaque data expression.
  3. Documenting users' participation processes through short films became a critical part of the research analysis, revealing how users perceive, remember, and generate meaning from the symbolic data objects.
• Advantages and Comparisons: Compared to traditional data visualization methods, Inner Ear emphasizes sensory experience and memory, forming a stark contrast to devices that prioritize precise and direct data interpretation. It fosters a deeper connection between data and emotions, memory, and physical space.
• Experimental or Evaluation Results:
  • Staged interviews with participants revealed that Inner Ear successfully altered their definitions of data. For instance, data was seen as a cultural symbol and emotional carrier rather than merely a technical artifact.
  • Participants continuously reinterpreted data during their experiences, a process imbued with subjective memory and emotional nuances, indicating that data physicalization can effectively help establish a deeper personal connection with data.
• Limitations and Future Directions:
  1. The universality and operational cost of data physicalization methods remain practical challenges.
  2. Future research could explore richer material media (e.g., non-ceramic materials), broader application scenarios, and even multi-user data interactions.
  3. Further reflection on the power dynamics between participants and researchers is needed to optimize the ethical practices of research tools in anthropological studies.

Conclusion

Inner Ear reimagines the relationship between humans and data, not only conveying personal perceptions of data through the integration of technology and art but also broadening the research perspective in this field. By blurring data and symbolic expression and emphasizing aesthetics and tactility, this study presents a profound model for universal data physicalization and data ethics.