Blending the Worlds: An evaluation of World-Fixed Visual Appearances in Automotive Augmented Reality

Research Background and Issues

• What problems or challenges did the authors identify?

  • With the increasing prevalence of autonomous vehicles in the future, passengers will have more time to engage in non-driving-related tasks (NDRTs), making the optimization of passenger experience increasingly important.
  • An innovative approach is to use augmented reality (AR) technology to provide passengers with real-time location information about their surroundings, such as location-based points of interest (POIs).
  • Current research in this area often relies on simulated environments or lacks in-depth exploration of real-world dynamic vehicle scenarios.

• Why is this issue important?

  • Passengers' perception and interaction with their surrounding environment can not only enhance the travel experience but also provide practical value through meaningful information displays (e.g., restaurants, traffic conditions).
  • The widespread adoption of autonomous vehicles will free people from driving tasks, creating new demands for innovative interaction and information display methods.

• Research Motivation and Related Work

  • Existing research has found that AR can enhance the travel experience for passengers, but most experiments use static or simulated environments.
  • Furthermore, there has been insufficient research on achieving accurate and user-acceptable AR POI display forms in dynamic vehicle scenarios.

Solution

• What methods or solutions did the authors propose?

  • Developed an AR system called "Blending the Worlds," which uses a head-mounted display (HMD) to present real-time POIs in dynamic vehicle scenarios.
  • Explored multiple POI visualization parameters, including height, size, rotation, rendering distance, information density, and appearance.

• What is innovative about this solution?

  • Conducted dynamic experiments in real vehicle scenarios using a video-see-through HMD (Varjo XR-3), avoiding the limitations of traditional simulated environment testing.
  • The multi-parameter adjustment experiments provide guidance for future automotive AR UI design, extracting UX design principles from user needs and experiences.

• What are the implementation steps and key technologies used?

  1. POI Visualization Design:
     • POIs were presented as transparent-bordered spheres containing embedded information (e.g., name, rating, and image). The color scheme and design were aligned with the interior style of high-end vehicles.
  2. Experiment Design:
     • Adjusted six parameters such as height, size, and rendering distance to evaluate user experience under different conditions.
  3. Data Collection:
     • Recruited 38 participants to conduct tests in real vehicle driving environments, recording quantitative user ratings and feedback.
  4. Technical Implementation:
     • Utilized a high-resolution HMD (Varjo XR-3) supporting six degrees of freedom tracking and low-latency video switching, integrated with an in-car computing unit.

Research Outcomes

• What specific outcomes were achieved?

  • Identified optimal visualization preferences for AR POIs in dynamic vehicle scenarios, including:
    • Height: POIs should be placed near the user's eye level and dynamically scaled for distant objects.
    • Size: A base size of approximately 3 meters, dynamically adjusted based on distance.
    • Rotation: POIs should always face the user (billboarding behavior).
    • Information Density: Each POI should include at least the name, image, and rating, with hierarchical information display based on distance.
    • Appearance Design: Circular, futuristic designs were widely favored, though color choices were contentious (user customization is needed).
  • Users generally accepted the AR functionality and believed it would have higher value in fully autonomous driving scenarios.

• What advantages does it have compared to existing solutions?

  • Validated dynamic application scenarios through real-world experiments, offering higher external validity than studies conducted in simulated environments.
  • Provided multi-parameter, multi-condition comparative analysis, offering data-driven UX design principles with practical guidance.

• What were the experimental or evaluation results?

  • User experience (e.g., comfort, visibility) scored highest under conditions of low height at eye level and dynamic scaling.
  • Significant differences were observed in user preferences for information density and appearance design, with some users expressing a desire for higher information density or flexible UI customization.

• Limitations and Future Directions

  • Limitations:
    • The study was limited to an industrial area environment at a speed of 30 km/h, lacking validation in other environments (e.g., urban areas or highways).
    • Experiments only considered the user experience of backseat passengers, excluding front-seat testing.
    • The head-mounted device used (980g) may affect user comfort during prolonged wear.
  • Future Directions:
    • Conduct tests in more diverse environments (e.g., urban areas, highways, trains) and integrate real POI data.
    • Explore interactive functionalities, such as direct booking or navigation through POIs.
    • Investigate personalized customization of POI content and display formats.
    • Examine the impact of different passenger positions on AR UX design, including scenarios involving shared transportation.

This study provides comprehensive and practical design guidelines for AR technology in dynamic vehicle scenarios and paves the way for enhancing passenger experiences in the context of future autonomous driving.