A Placebo Concert: The Placebo Effect for Visualization of Physiological Audience Data during Experience Recreation in Virtual Reality

Research Background and Problem

• Issues and Challenges:

  • Virtual Reality (VR) faces challenges in recreating real-world scenarios, such as ensuring users' physiological responses align with those of actual audience members in real-life situations.
  • Current research primarily focuses on the measurement and visualization of authentic physiological data to enhance the precision of experiences but has yet to deeply explore the impact of fabricated data on user experience.
  • There is a research gap in investigating the placebo effect in the visualization of physiological data, which could significantly influence users' performance and self-perception.

• Significance:

  • Enhancing the realism and immersion of VR experiences contributes to broader application scenarios, including entertainment and training.
  • Investigating the perceptual impact of visualizing different types of physiological data (authentic, mismatched, and fabricated) can reveal critical mechanisms in VR design.

• Research Motivation and Related Work:

  • Related studies indicate that dynamic physiological signals can enhance emotional synchronization among users in multi-user interactions, but achieving this synchronization in VR remains challenging.
  • Research on the placebo effect in the field of Human-Computer Interaction (HCI) is limited, particularly regarding how the visualization of physiological data influences user perception and behavior.

Solution

• Methods or Solutions:

  • The authors developed a VR scenario based on physiological data visualization to replicate audience physiological responses during a concert.
  • By visualizing authentic physiological data, fabricated data, and mismatched data, the study examines the impact of different data contexts on user experience.
  • A user study (n=44) was designed, dividing participants into two groups: informed and uninformed, to explore the existence of the placebo effect.

• Innovations:

  • Introducing fabricated data as a control condition to explore whether users, when misled into believing the data is real, experience a placebo effect.
  • Developing a modular data visualization system that supports dynamic visualization of physiological data, integrating and displaying data from individuals to entire groups.

• Implementation Steps:

  1. Data Collection: Recorded physiological data (including EDA and BVP) from 50 actual concert attendees.
  2. Data Processing: Enhanced data quality through preprocessing steps such as filtering and normalization.
  3. Individual Visualization: Transformed physiological data into 3D models simulating individual physiological states.
  4. Group Visualization: Integrated data from multiple individuals to generate dynamic visualizations of the entire audience.
  5. User Experiment: Conducted experiments under four visualization conditions (no visualization, real matched data, real mismatched data, and fabricated data), with participants divided into informed and uninformed groups.

Research Outcomes

• Specific Findings:

  • Visualizing physiological data significantly enhanced user engagement and co-presence, particularly in the informed group.
  • In the informed group, even when the data was fabricated, randomly generated data still elicited positive emotional responses, revealing the presence of the placebo effect.
  • Dynamic visualization of fabricated data induced high levels of physiological synchronization (EDA baseline) in the informed group, surpassing real matched data.

• Comparison with Existing Solutions:

  • Unlike traditional visualization approaches relying on authentic data, the study demonstrates that fabricated data can enhance user experience in appropriate contexts.
  • Ambiguous and interpretable fabricated visualizations encourage users to assign their own meanings, deepening emotional resonance.

• Summary of Experimental Results:

  • Participants in the informed group exhibited higher levels of pleasure and arousal under fabricated data conditions.
  • Participants exposed to dynamic visualization of fabricated data demonstrated greater long-term physiological synchronization (EDA tonic).
  • However, the high dynamic activity of fabricated data may reduce short-term physiological response synchronization (EDA phasic).

• Limitations and Future Directions:

  • Further exploration is needed to understand why certain conditions (e.g., mismatched data) performed better in the uninformed group, particularly the impact of visual variation rates on emotional and physiological responses.
  • It remains unclear whether explicitly informing participants about the authenticity of fabricated data would still trigger a placebo effect, necessitating new experimental designs for verification.
  • Future research could explore generating multiple visual effects from authentic data and examine their psychological and physiological impacts.

Conclusion

This study reveals the potential impact and application value of physiological data visualization design in Virtual Reality. By skillfully leveraging the placebo effect, dynamic visualization of fabricated data significantly enhances user engagement and emotional resonance. This opens up new possibilities for design strategies while suggesting that future research should further investigate how users' perceptions of data authenticity alter experiential outcomes.