Meme, Myself and AR: Exploring Memes Sharing in Face-to-face Conversation using Augmented Reality

Paper Title

Meme, Myself and AR: Exploring Memes Sharing in Face-to-face Conversation using Augmented Reality

Publication Info

• Topic area: Integration of internet memes into face-to-face conversations using augmented reality (AR).
• Keywords: Internet memes, augmented reality, face-to-face communication, AR memes, conversational dynamics, meme visualization, social interaction, humor, XR, multimodal communication.

Background and Problem

• Problem / challenge: Internet memes, central to online communication, lose their visual humor in face-to-face (F2F) conversations. Existing AR solutions focus on instrumental information (e.g., maps) rather than communicative acts like memes, leaving a gap in understanding how memes can be integrated into F2F interactions via AR.
• Significance: Addressing this gap can enhance social interactions by leveraging memes' humor and cultural references, enriching F2F communication with new forms of expression.
• Motivation and related work: Prior studies have explored meme usage in offline communication and AR applications for referential information. However, memes as communicative acts with narrative and emotional depth remain underexplored in AR-mediated F2F contexts. This paper builds on the vision of "Everyday AR" to investigate how memes can transform F2F interactions.

Solution

• Proposed approach: Development of an AR meme-sharing prototype to integrate memes into F2F conversations, allowing users to visualize and interact with memes in real-time.
• Novelty:
  1. Identification of three AR meme visualization archetypes: The-Meme-on-Me, Me-in-the-Meme, and Meme-as-Visual-Reference.
  2. Analysis of two integration patterns for AR memes in conversations: Sequential and Parallel.
  3. Exploration of how AR memes influence conversational dynamics and create playful social interactions.
• Procedure and key techniques:
  • Conducted an online survey (N=29) to understand motivations and challenges of visualizing memes in F2F conversations.
  • Developed a multi-user AR prototype enabling meme visualization.
  • Conducted a lab study with 12 pairs of friends (N=22) to co-design AR meme visualizations and use them in conversations.
  • Used thematic analysis and Perceived Interaction Quality (PIQ) questionnaires to evaluate conversational dynamics and user perceptions.

Results

• Concrete findings:
  • Three AR meme visualization archetypes:
    1. The-Meme-on-Me: Merging meme characters with users' bodies.
    2. Me-in-the-Meme: Situating users within meme environments.
    3. Meme-as-Visual-Reference: Using memes as visual augmentations in 2D or 3D forms.
  • Two integration patterns in conversations:
    1. Sequential: Memes and speech alternate, with memes serving as punchlines or setups.
    2. Parallel: Memes and speech occur simultaneously, amplifying humor or assisting storytelling.
  • High user interest in AR memes (5.77/7 Likert scale) and enjoyment (5.86/7 Likert scale).
• Advantage over baselines:
  • AR memes did not impair conversation quality compared to a baseline condition without meme visualization, as shown by PIQ scores.
  • AR memes enabled playful interactions, such as trolling, remixing, and spamming memes.
• Experiments / evaluation:
  • Study 1: Online survey with 29 participants to explore motivations and challenges.
  • Study 2: Lab study with 11 pairs of friends using AR memes in conversations, supported by thematic analysis and PIQ questionnaires.
  • Prototype built on Meta Quest 3 with Unity3D, enabling real-time meme sharing and manipulation.
• Limitations and future work:
  • Limited visualization options in Study 1 may have constrained participant creativity.
  • Preselected memes and topics in Study 2 may have influenced conversational spontaneity.
  • Current AR headsets block users' faces, affecting natural interaction.
  • Future work could explore generative visualization tools, real-time meme search, and less intrusive AR glasses.

Summary

This paper investigates how internet memes can be integrated into face-to-face conversations using augmented reality. Through two studies, the authors identified three AR meme visualization archetypes and two conversational integration patterns, demonstrating how AR memes enhance humor and social interaction. The findings suggest that AR memes blend digital content with users' actions and environments, creating a unique genre of communication. While AR memes showed high user interest and enjoyment, challenges such as technical friction and headset intrusiveness remain. Future research could focus on generative tools, real-time meme recommendations, and improved AR hardware.