DataDancing: An Exploration of the Design Space For Visualisation View Management for 3D Surfaces and Spaces

Title of the Paper

DataDancing: An Exploration of the Design Space for Visualization View Management for 3D Surfaces and Spaces

Paper Information

• Research Area: Human-Computer Interaction, Virtual Reality, and Data Visualization
• Keywords: Data Visualization View Management, Design Space Exploration, Immersive Analytics, Virtual Reality, 3D Surfaces and Spaces

Research Background and Problem

• Issues or Challenges:

  • Existing immersive data visualization systems typically arrange visualization views in fixed wall or tabletop layouts, which are limited to two-dimensional spaces and fail to utilize the three-dimensional space surrounding the user.
  • Current visualization view management systems rely on traditional hand-based interactions, without fully exploring other bodily interaction possibilities (e.g., foot-based interactions).
  • In multi-view environments, optimizing the layout and interaction of views to enhance user experience and task efficiency remains a challenge.

• Significance of the Problem:

  • With the development of virtual reality (VR) technologies, data visualization systems can leverage three-dimensional spaces to provide more flexible layouts and interaction designs, enabling users to adjust and manage views more freely.
  • Data visualization is a critical tool for scientific analysis, decision support, and education. Improving the design of visualization view management in immersive environments is key to enhancing efficiency and user satisfaction.

• Research Motivation and Related Work:

  • While previous work has explored multi-view layouts (e.g., wall-mounted or tabletop displays) using two-dimensional window management approaches, these solutions have not fully considered utilizing different parts of the user's body, such as the feet and overall body posture.
  • The authors reference studies on design spaces for immersive low-scale views, emphasizing the potential for 3D view management in modern immersive environments.

Solution

• Methods or Solutions:

  • Propose a design space framework called "DataDancing" for managing visualization views in immersive environments.
  • Conduct a systematic literature review to extract and analyze existing visualization designs and interaction techniques, summarizing 11 design dimensions, including view presentation (spatial awareness and reference frameworks) and user interaction dimensions (interaction styles and action goals).
  • Develop multiple view management prototypes, covering various reference frameworks and interaction methods, such as wall displays, floor displays, tabletop displays, body-mounted displays, and cockpit displays.
  • Design and conduct user experiments to evaluate the task performance, user experience, and preferences for each prototype.

• Innovations:

  • Integrate various bodily interaction methods (e.g., foot-based and full-body interactions) to explore the layout and management of visualization views in 3D spaces.
  • Creatively employ foot pressure sensors and motion tracking systems to support foot-based interaction tasks.
  • Introduce hybrid prototype designs that combine public (wall displays) and private spaces (cockpit displays) with different interaction modes.

• Implementation Steps and Key Technologies:

  • Systematically address design dimensions, including perspectives (e.g., egocentric and exocentric), view mobility, interaction styles (explicit/implicit interaction), and input methods (e.g., hands, feet, body).
  • Conduct a literature review and theoretical exploration of the design space to classify existing work and propose new possibilities.
  • Build and test four prototype systems with specific task designs.
  • Use VR devices and sensors to track user body and foot movements for interactive scenarios.

Research Outcomes

• Specific Outcomes:

  • Propose a design space for immersive data visualization, including spatial dimensions (e.g., 2D/3D coordinate systems) and user interaction dimensions (e.g., interaction types).
  • Implement and evaluate four prototype designs, representing different types of 3D spatial layouts and interaction methods (e.g., combinations of wall and floor displays, cockpit displays with foot-based interactions).
  • Collect user preferences and experiential feedback to provide both quantitative and qualitative insights for visualization view management design.

• Advantages:

  • Compared to current solutions, better utilization of 3D spaces and the user's bodily interaction capabilities.
  • Provide freely movable reference frameworks (e.g., cockpit displays) suitable for individual use and collaborative tasks.
  • Pioneer the exploration of foot-based interactions in immersive environments, laying the foundation for future multimodal interaction research.

• Experimental/Evaluation Results:

  • User experiments revealed that traditional wall + tabletop layouts were the most favored, while foot-based interactions required more adaptation time and refined task designs.
  • Although foot-based interactions were less efficient and accurate than hand-based ones, they were considered intuitive, easy to learn, and capable of reducing hand fatigue.

• Limitations and Future Directions:

  • Foot-based interactions introduced issues such as neck fatigue and lower interaction precision, necessitating improvements in haptic design and posture sensing technologies.
  • Body-mounted displays are suitable for individual tasks but offer limited support for collaboration, suggesting the need to explore dynamic transition mechanisms in hybrid spaces.
  • Consider extending to tasks involving larger datasets and more complex layouts, including automated dynamic adjustments of views.

This research opens new directions for immersive data visualization and interaction design, potentially enhancing system flexibility and user experience.