MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis

Title of the Paper

MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis

Paper Information

• Research Domain: Visual data analysis, augmented reality, mobile device interaction
• Keywords: data visualization, mobile devices, head-mounted augmented reality, inter-device interaction, data analysis, mobile data visualization, augmented display, immersive analysis

Research Background and Problem

• Problems and Challenges:

  1. The limited screen space of mobile devices restricts the expressiveness of complex data visualizations and user interactions.
  2. Existing applications of augmented reality technology combined with displays are predominantly focused on desktop or large monitor environments, with limited systematic research in the mobile device domain.
  3. There is a lack of effective solutions for the complexity of multi-device collaboration and interaction, as well as the visualization relationships between devices.

• Significance:

  1. As mobile devices become the primary computing tools in daily life, their potential in professional data analysis is gaining attention.
  2. Augmented reality (AR) offers infinite screen space and 3D display capabilities, effectively extending the display performance of mobile devices.
  3. The ability to support multi-device collaboration and multi-user environments is critical for future immersive analysis and cross-device interaction.

• Research Motivation and Related Work: The authors integrate findings from the fields of information visualization (InfoVis) and human-computer interaction (HCI) to explore how mobile devices can be combined with head-mounted augmented reality devices to enhance the data analysis experience. They highlight the advantages of mobile devices in convenient and precise data interaction while emphasizing AR's ability to provide seamless extensions and immersive contextual information.

Solution

• Method or Solution: The authors propose a conceptual framework called MARVIS, designed to combine mobile devices and head-mounted augmented reality devices for visual data analysis. The core concept leverages AR technology to extend the screen space of mobile devices, enhance 2D and 3D data visualization, and optimize inter-device data relationships.

• Innovations:

  1. The MARVIS framework systematically describes visualization principles for extending mobile displays using augmented reality, addressing the issue of limited screen space on mobile devices.
  2. It supports interaction and data association across multiple devices, such as visualizing inter-device relationships and connections through augmented reality.
  3. The framework introduces novel visualization methods, including "AR displays around devices," "overlay-based 3D visualization," and inter-device relationship visualization.

• Implementation Steps: MARVIS consists of four core components:

  1. Design Process: Conducting multiple rounds of interviews with visualization experts to establish the system's design logic.
  2. Concept Development: Creating visualization and interaction techniques for single and multi-device setups to support common visualization tasks.
  3. Prototype Validation: Developing a prototype application with six use cases, such as SPLOM navigation, network graph and attribute visualization, and map extension.
  4. Expert Evaluation and Feedback: Collecting feedback through expert user reviews and hands-on experiments to refine the design.

Research Results

• Specific Results:

  1. A prototype was developed to demonstrate the integration of multi-device and augmented reality visualization, showcasing its applicability and effectiveness through specific use cases.
  2. The six use cases covered various visualization tasks, including 3D paths, stacked bar charts, SPLOM, and map navigation.
  3. Expert evaluations indicated that the proposed design principles effectively enhance the efficiency and user experience of complex data analysis processes.

• Advantages:

  1. Significantly improved the applicability of mobile devices in professional data visualization tasks.
  2. Provided a flexible and intuitive operation method by combining physical devices and augmented reality, enabling users to perform detailed data exploration with ease.
  3. Established a theoretical and practical foundation for developing future multi-device and augmented reality visualization applications.

• Experiment or Evaluation Results: Hands-on experiments and evaluations conducted with seven visualization and HCI experts revealed:

  • Positive feedback on the system's integration of augmented reality and data visualization.
  • Suggestions for improvement, including enhancing AR interactions and adjusting spatial alignment between AR content and devices.
  • Confirmation that the framework effectively addresses challenges related to limited screen space and multi-device collaboration.

• Limitations and Future Directions:

  1. Current technical limitations of head-mounted AR devices, such as field of view (FoV) and resolution, affect the display of detailed information.
  2. Accuracy and ease of device positioning and registration in non-laboratory environments require further optimization.
  3. The authors recommend exploring how the MARVIS framework can be extended to specific applications, such as other visualization domains or domain-specific use cases.

By expanding this framework, future research could investigate how augmented reality can be applied to other types of display devices and complex interaction scenarios, such as multi-user collaborative environments or workspace awareness support.