Make Interaction Situated: Designing User Acceptable Interaction for Situated Visualization in Public Environments

Document Title

Make Interaction Situated: Designing User Acceptable Interaction for Situated Visualization in Public Environments

Document Information

• Subject Area: Human-Computer Interaction and Contextual Visualization Design in Augmented Reality
• Keywords: Situated Visualization, Interactive Techniques, Social Acceptability, Public Environment, User Experience, Augmented Reality (AR), Interaction Design, Usability, Multimodal Input, Contextual Constraints

Research Background and Issues

• Problems or Challenges Identified by the Authors:

  • Social acceptability and environmental constraints are major challenges when interacting with situated visualizations in public environments.
  • Users may consider the social appropriateness of interaction gestures in public spaces, such as whether these gestures draw attention or disturb others.

• Significance:

  • Situated visualization, by tightly integrating data with the physical environment, supports real-time data analysis and decision-making and represents a promising application of augmented reality technology.
  • Designing socially acceptable interaction methods in public environments can enhance user experience and increase the social acceptance of the technology.

• Research Motivation and Related Work:

  • Current research primarily focuses on designing interactions for situated visualizations using physical references, with insufficient consideration of users' social awareness in public spaces.
  • Beyond data presentation, this study aims to design socially acceptable interaction methods that meet user needs and address technology adoption challenges.

Solution

• Proposed Solution:

  • The authors conducted formal studies to understand user needs, followed by the development and evaluation of interaction techniques based on eye tracking, hand gestures, and spatially aware objects. These techniques were integrated into an augmented reality prototype for situated visualization in public environments.

• Innovations:

  • Proposed a series of multimodal interaction techniques suitable for public contexts, balancing user needs and social acceptability.
  • Emphasized that interaction design should consider user behavior patterns and social adaptability, while also accounting for constraints in real-world environments.

• Implementation Steps:

  1. Formal Study: Conducted observations and in-depth interviews with 12 participants in public settings (libraries and stores) to identify user needs.
  2. Iterative Design: Developed interaction techniques based on identified needs and continuously refined the design through testing and user feedback.
  3. Experimental Evaluation: Designed comparative experiments in public settings to test the effectiveness and acceptability of the proposed interactions versus traditional methods.

Research Outcomes

• Specific Outcomes:

  • Designed interaction techniques based on user needs, including eye tracking, touch interaction, and spatially aware object interactions, enabling users to trigger and analyze situated visualization information.
  • Provided a framework for integrating interactions into situated visualizations and offered design guidelines for real-world applications.

• Advantages Over Existing Solutions:

  • Compared to traditional gesture-based interaction techniques, the proposed methods align better with user behavior patterns and are more socially acceptable in public environments.
  • The prototype system enhances flexibility and user experience by combining multimodal interactions to accommodate various data analysis tasks.

• Experimental or Evaluation Results:

  • In store and library scenarios, users rated the new interaction techniques significantly higher in terms of acceptability, usability, and engagement compared to baseline systems.
  • Most participants found the new interaction methods discreet and natural, avoiding embarrassment or disturbance when used in public spaces.

• Limitations and Future Directions:

  • Limitations: Did not include bystanders' perceptions of the interaction techniques; some interaction solutions were not fully realized due to current device stability constraints.
  • Future Directions:
    • Extend research to include the social acceptability dimension from bystanders' perspectives.
    • Explore interaction use cases without explicit task goals.
    • Integrate emerging devices and technologies to optimize existing interaction designs and improve their reliability and stability.

Conclusion

This study not only provides a feasible solution for interaction design in situated visualization within public environments but also systematically explores the impact of social acceptability on design. It offers significant insights for practical applications in the fields of human-computer interaction and augmented reality.