Supporting Piggybacked Co-Located Leisure Activities via Augmented Reality

Paper Title

Supporting Piggybacked Co-Located Leisure Activities via Augmented Reality

Paper Information

• Domain: Augmented Reality (AR) Technology and Collaborative Interaction Design
• Keywords: Augmented/Mixed Reality, Collaborative Interaction, Human-Pet Interaction, Everyday Leisure Activities, Simulated Scenario Interaction Design

Research Background and Issues

• Identified Challenges and Issues:

  • Digital technologies (especially smartphones) are often perceived as disruptive to physical-world interactions between people, leading to social detachment and the creation of "digital bubbles."
  • There is a lack of specifically designed technologies that integrate digital interaction design with everyday leisure activities to enhance collaborative interactions.
  • Current research on augmented reality design lacks in-depth exploration of enhancing existing activities (e.g., pet interactions, meditation-related interactions).

• Importance of the Issues:

  • Improper use of technology may reduce the quality and significance of face-to-face interactions.
  • Exploring design methods to bridge the gap between technology and physical interaction, and better integrating digital devices with social interactions, can foster richer and more intimate interaction scenarios between humans and between humans and pets.

• Research Motivation and Related Work:

  • Introduces the new concept of "piggybacking," which does not create entirely new interactions but instead builds on existing everyday leisure activities to enhance them with technology.
  • The research focuses on designing technology to support shared, enduring interactions in existing scenarios, rather than treating technology as an isolated or passive tool.

Solution

• Proposed Methods or Solutions:

  • Developed three augmented reality applications—Mindful Garden (a meditation garden), Compurrsers (a music generator for interacting with cats), and Petpet (a digital "companion" for interacting with dogs).
  • Application design centers on the concept of "piggybacking," focusing on adding digital elements to existing leisure activities (e.g., human-pet interactions or shared moments).
  • Enhanced interaction experiences by linking physical and digital signals (e.g., detecting pet emotions or enabling a virtual garden to grow during meditation).

• Innovative Aspects of the Solution:

  • The piggybacking design pattern, which enhances existing daily activities rather than creating entirely new ones.
  • Close coupling of information from the physical and digital worlds, creating new interaction scenarios through mobile devices and augmented reality technology.
  • Emphasis on multi-party collaboration among humans, pets, and the environment to enhance interactions, rather than focusing solely on individual user experiences.

• Implementation Steps and Key Technologies:

  • Integrated augmented reality applications with the Snapchat platform using "Lens Studio" for development.
  • Developed animal emotion recognition models and machine learning techniques to generate dynamic outputs during pet interactions.
  • Designed applications that are concise, diverse, and provide lasting interactive value, such as savable memories, personalized gardens, or pet avatars.

Research Outcomes

• Specific Outcomes:

  • Designed and deployed three augmented reality applications to support enhanced shared social scenarios or human-pet interactions.
  • Participant studies revealed that AR technology can inspire creativity, increase interaction motivation, and enhance existing daily activities.
  • Proposed seven insights, including AR's capacity to inspire, the emphasis on physical interaction, and the need for personalization and persistence.

• Advantages Over Existing Solutions:

  • Unlike existing single-user augmented reality applications, this study emphasizes multi-party collaboration and the enhancement of physical interactions.
  • Provides uniquely personalized designs directly linked to the user's physical space.

• Experimental or Evaluation Results:

  • Experiments involving 41 participants (including humans and pets) demonstrated positive user experiences with the innovative applications and favorable evaluations of how the applications extended existing activities.
  • While each application's design had its strengths, users also suggested improvements, such as optimizing interaction persistence and strengthening the coupling of physical and digital signals.

• Limitations and Future Directions:

  • The short duration of the study only captured participants' initial experiences with the applications, without exploring long-term effects.
  • The limited sample size necessitates expanding the study population to verify adaptability.
  • Future directions include extending piggybacking AR scenarios into fields such as education and healthcare, and further exploring the impact of personalization and signal coupling on user experiences.