Reality Rifts: Wonder-ful Interfaces by Disrupting Perceptual Causality

Title of the Paper

Reality Rifts: Wonder-ful Interfaces by Disrupting Perceptual Causality

Paper Information

• Domain: Human-Computer Interaction, Mixed Reality, Immersive Experiences
• Keywords: Mixed Reality, Perceptual Causality, Imagination-based Interfaces, Physical Displays, Immersive Experience, User Imagination, Perceptual Inconsistency, Augmented Reality, Interaction Design

Research Background and Issues

• Identified Problems or Challenges:

  • Humans develop cognitive models of real causal relationships when exploring and interacting within physical environments, which allow them to predict and verify interaction outcomes. However, these real-world causal rules may not apply in virtual or mixed reality environments.
  • Virtual worlds often provide surprises and sensory stimulation but fail to fully evoke the expected sense of "wonder" due to rules that diverge from real-world physical laws.

• Significance:

  • Enhancing user curiosity and imagination strengthens the connection between users and physical interactive systems, improving immersion and entertainment experiences.
  • Investigating how breaking perceptual causality in interaction design can cultivate a sense of "wonder" and advance mixed reality development.

• Motivation and Related Work:

  • Drawing inspiration from magic and education, the study aims to create interactive experiences imbued with mystery and curiosity by disrupting users' understanding of perceptual causality.
  • While related fields have explored multisensory feedback, perceptual continuity in virtual reality, and physical display technologies, few studies have examined breaking perceptual causality to stimulate user imagination.

Solution

• Proposed Method:

  • Introducing "Reality Rifts," an interaction design concept that connects physical and virtual realities by removing parts of the physical causal chain and re-simulating outcomes to create a sense of "inconsistency," thereby stimulating user curiosity and imagination.

• Innovations of the Solution:

  • Establishing a three-step method for designing Reality Rifts:
    1. Identifying causal relationships in interactions.
    2. Intentionally breaking the perceptual causal chain (e.g., hiding intermediate phenomena).
    3. Restoring physical outcomes using hidden sensors and actuators while maintaining overall causal plausibility.
  • Introducing a multidimensional design space to regulate the intensity of users' "sense of wonder" by reducing perceptual clarity.
  • Expanding mixed reality to imagination-based interaction modes.

• Implementation Steps and Key Technologies:

  1. Identifying Physical Interactions: Select perceptible causal relationships, typically involving user input and object response, and determine target interactions using spatial and temporal continuity.
  2. Breaking Perceptual Causality: Hide significant phenomena in intermediate stages (e.g., object appearance or physical reactions) to enhance user imagination.
  3. Restoring Outcomes: Simulate and present final observable results using alternative systems (e.g., sensors, disguised physical actuators, or transparent systems).
  4. Use physical prototypes to demonstrate designs, and refine and optimize them to provide users with consistent physical experiences.

Research Outcomes

• Specific Results:

  • Developed six proof-of-concept prototypes, including a faucet, slingshot, fan, lighter, screwdriver, and axe, which guide user imagination and evoke wonder by hiding parts of the physical causal chain.
  • Conducted field tests in an escape room environment with 50 participants interacting with and evaluating these prototype designs.
  • Experiments demonstrated that "Reality Rifts" achieved higher levels of curiosity and enjoyment compared to fully physical interactions.

• Advantages:

  • Benchmark Comparison: Reality Rifts successfully removed physical components from the causal chain while triggering user curiosity and immersion.
  • Scalability: The method can be applied to educational displays, immersive escape games, and even assistive experiences for visually impaired individuals.

• Experimental or Evaluation Results:

  • User curiosity scores for Reality Rifts were significantly higher than for purely physical baseline conditions (Rift average score = 6.03 vs. baseline average score = 4.17).
  • User enjoyment scores under Rift conditions were also significantly higher than baseline conditions (Rift average score = 6.00 vs. baseline average score = 4.98).
  • The screwdriver and slingshot prototypes were rated as the most "wonder-ful" interaction designs.

• Limitations and Future Directions:

  • Current simulation models face limitations, such as the fan failing to fully replicate expected airflow.
  • Devices require further disguise and optimization to enhance the realism of Reality Rifts.
  • Further research is needed to design experiments and validate findings in more complex environments and multi-user interactions.
  • Expanding these design principles to education, accessible experiences for visually impaired individuals, and artistic exhibitions.

Conclusion

This paper introduces the Reality Rifts design method, demonstrating how breaking perceptual causality can trigger user senses and imagination, and proposes a new direction for mixed reality design. Experimental results show that this design successfully creates immersive, exploratory, and enjoyable interactive experiences, offering significant insights into understanding users' "sense of wonder." The paper provides inspiration for designing new systems that integrate virtual, physical, and imaginative realities.