Sonic Delights: Exploring the Design of Food as An Auditory-Gustatory Interface

Research Background and Problem

• Problem and Challenges:
  The authors, in examining research on Human-Food Interaction (HFI), observed that while attempts to integrate sound with food experiences are increasing, current methods primarily focus on generating sound through external devices. Few studies have genuinely considered food as a material carrier for sound interaction. In these existing systems, sound often exists independently of the actual consumption of food, overlooking the potential of integrating food materials with digital sound.

• Significance and Motivation:
  Sound as a component of gustatory experience has been underestimated. When sound is fused with taste, it not only influences the perception of food texture, flavor, and taste but also has the potential to regulate eating behavior by creating sound-taste contrasts, reducing sugar or salt intake, and enhancing the enjoyment of meals. Furthermore, this study explores redefining food as an interactive, multisensory medium, replacing traditional non-edible technological components and promoting sustainable interaction design.

• Related Work:
  The study reviewed experimental examples in the HFI field involving sound, such as enhancing chewing sounds through external devices (e.g., "Chewing Jockey") and using food to construct music playback devices (e.g., "Edible Vinyl Records"). However, these technologies often overlook the potential of "food itself" as the primary material for sound interaction.

Proposed Solution

• Proposed Solution:
  The authors envisioned and designed the "Sonic Delights" system, which uses food to create edible speakers capable of playing sound. This system directly integrates sound production with the material properties of food. As users consume the food, it not only plays digital sounds but also gradually diminishes the sound as the food is consumed, simulating the experience of "consuming sound."

• Innovations:

  1. Utilizing food itself as a computational material with input/output functionality, enabling sound experiences during chewing.
  2. Introducing the concept of "food interpretation" for edible speakers, breaking the traditional boundaries between technological components and digital interaction.
  3. Addressing the unexplored space of "multisensory interaction" in sensory design, bridging taste, vision, and hearing.

• Implementation Steps and Key Technologies:

  1. Conceptualization and Prototype Exploration: Based on the principles of flat flexible speaker fabrication, edible speaker diaphragms were constructed using food-grade materials (e.g., gold leaf) to convert electrical signals into sound.
  2. Food Material Selection and Processing: Core components of the edible speaker include lightweight, high-rigidity food diaphragms (e.g., rice crackers) and conductive materials (e.g., edible gold leaf).
  3. Sound System Integration: A system was designed comprising a low-power amplifier, an electromagnet, and a Bluetooth input signal module. The system achieves a unique auditory perception through the characteristic of "sound diminishing with chewing."
  4. Variants of Transmitting Coil Design: Artistic and diverse designs for sound-emitting coils were proposed, ranging from traditional spiral configurations to abstract visual art forms (e.g., butterflies, human faces), exploring the integration of visual art and functionality.

Research Outcomes

• Key Findings:

  1. System Design: Developed an edible speaker and audio playback system made from food, enabling users to experience a unique multisensory interaction during consumption.
  2. Thematic Insights: User studies identified five major experiential themes in multisensory design, such as perceiving the "liveliness" of food, enhancing emotional connections, and creating an immersive overall sensory experience.
  3. Design Implications: Practical guidelines for multisensory interaction design were proposed, including the integration of material aesthetics with digital outputs, adaptive design for immediate sensory feedback, and enhancing emotional bonds through anthropomorphic interactions.

• Comparison with Existing Solutions:
  This system uniquely positions "food" as an active material for sound interaction, rather than merely a medium for sound transmission or a supplement to external devices. It advances sensory integration and interactivity to a new level.

• Experimental or Evaluation Results:
  User experience studies revealed that when sound is played through edible speakers rather than external devices, the experience becomes more immersive, intimate, and personalized. The synchronization of visual design with sound elicited stronger personalized associations and emotional responses among users. Additionally, participants expressed strong interest in the integration of food "liveliness" with sound experiences.

• Limitations and Future Directions:

  1. The current system still relies on non-edible components (e.g., amplifiers and magnets). Future research should explore fully edible and biodegradable devices.
  2. The choice of textures for edible speakers is currently limited, necessitating further exploration of diverse taste and structural options.
  3. This study primarily focuses on the integration of auditory and gustatory senses, leaving tactile, olfactory, and visual aspects of fully immersive multisensory scenarios unexplored.

Conclusion

"Sonic Delights" opens up new possibilities for redefining food as an interactive medium, pushing the boundaries of human sensory experiences and food design into the future. It demonstrates a starting point for bridging material substances with digital interaction, offering valuable insights for the design of future multisensory interactions and food computing devices, while paving the way for more emotionally engaging dining experiences.