Envisioning Audio Augmented Reality in Everyday Life

Paper Title

Envisioning Audio Augmented Reality in Everyday Life

Publication Info

• Topic area: Exploring the potential roles and integration of Audio Augmented Reality (AAR) in daily life.
• Keywords: Audio Augmented Reality, everyday life, sound augmentation, human-computer interaction, collaborative autoethnography, survey study, auditory experience, design framework, context-aware systems, privacy concerns.

Background and Problem

• Problem / challenge: Despite advancements in visual AR, AAR remains underexplored, often treated as a secondary modality or limited to niche applications like assistive technologies and entertainment. There is a lack of understanding of how AAR can support general, everyday auditory experiences.
• Significance: Hearing plays a crucial role in sensing context, anticipating changes, and navigating social spaces. Overlooking AAR risks creating technologies that are visually rich but sensorially narrow, missing opportunities to enhance daily routines and interactions.
• Motivation and related work: Prior research has focused on task-specific applications of AAR, such as navigation, environmental perception, and entertainment. However, these studies lack a comprehensive exploration of AAR's potential in shaping everyday auditory experiences. This paper addresses this gap by examining how AAR can enrich daily life through grounded, user-centered insights.

Solution

• Proposed approach: The study employs a dual-method approach combining collaborative autoethnography (CAE) with an online survey to explore how people envision AAR in everyday life.
• Novelty:
  1. Identification of ten distinct roles for AAR, categorized into task-oriented, emotional/social, and perceptual collaborator roles.
  2. Introduction of a rhythmic and embodied collaborator framework, mapping AAR roles onto micro-, meso-, and macro-rhythms of daily life.
  3. Empirical grounding through lived experiences and broader survey data, offering a user-centered design framework for AAR systems.
  4. Exploration of tensions and concerns, such as balancing privacy, control, and social presence in AAR integration.
• Procedure and key techniques:
  • Collaborative Autoethnography: Five researchers documented 72 reflections on their auditory experiences over three weeks, identifying potential AAR applications.
  • Online Survey: A survey (N=74) gathered broader perspectives on imagined AAR use cases, control preferences, and concerns.
  • Thematic Analysis: Inductive coding of CAE and survey data to identify recurring themes and roles for AAR.

Results

• Concrete findings:
  • Ten AAR roles were identified: enhance, reduce, guide, personalise, anticipate, interpret, remember, simulate, reflect, and transform.
  • The most frequently envisioned roles were reduce (21.9%), personalise (18.6%), and enhance (17.2%).
  • Participants highlighted the importance of manual control, privacy, and adaptive systems that align with user preferences.
• Advantage over baselines:
  • Provides a more comprehensive and user-centered understanding of AAR compared to prior task-specific studies.
  • Introduces a rhythmic and embodied framework for designing AAR systems that align with everyday temporal and sensory patterns.
• Experiments / evaluation:
  • CAE: Depth of insight from 72 reflections across five researchers with diverse auditory experiences.
  • Survey: Broader perspectives from 74 participants, with quantitative and qualitative analysis of imagined roles and concerns.
  • Metrics: Frequency of role mentions, thematic clustering, and participant ratings of AAR features.
• Limitations and future work:
  • Small CAE sample size with shared disciplinary backgrounds limits generalizability.
  • Survey participants imagined AAR use rather than reflecting on direct experiences with working systems.
  • Future work should include prototype-based studies, longitudinal research, and exploration of multimodal AR scenarios.

Summary

This study explores how Audio Augmented Reality (AAR) can integrate into everyday life, identifying ten roles that range from enhancing and reducing sounds to supporting memory and social reflection. Using collaborative autoethnography and a survey, the authors provide a user-centered framework that maps AAR roles onto the rhythms of daily life. Key findings highlight the need for context-aware, privacy-preserving, and user-controlled systems. The study contributes to the design of AAR technologies that align with human sensory and social needs, while addressing challenges like automation accuracy and social legibility.