On-body Icons: Designing a 3D Interface for Launching Apps in Augmented Reality

Research Background and Issues

• What problems or challenges did the authors identify?
  Modern spatial operating systems (OSs) primarily launch applications through two-dimensional menus, which are time-consuming and constrained by menu structures. In augmented reality (AR), using virtual shortcuts on body surfaces to launch applications is a promising interaction method. However, how users choose body parts to place shortcuts and how they remember these locations has not been thoroughly studied.

• Why is this issue important?
  Using the body as an interaction reference offers advantages such as "always online" accessibility, speed, and support for non-visual input, making it suitable for emerging technologies like AR glasses. Understanding users' behaviors and strategies for placing shortcuts on the body can help design more natural, user-friendly, and personalized interaction interfaces while giving users greater control.

• Research Motivation and Related Work
  Although previous studies have explored the accuracy of triggering target locations on the body or social acceptability, there is a lack of in-depth exploration of how users choose shortcut placement locations and their reasoning. Prior research has mainly focused on hand-based interactions or limited body areas, lacking systematic exploration of shortcut placement strategies across the entire body.

Solution

• What methods or solutions did the authors propose?
  The authors proposed a novel augmented reality interface called "On-body Icons," which allows users to place virtual shortcuts on body surfaces (including skin, clothing, and accessories) and launch applications via touch. Key design elements include:

  1. Supporting shortcut placement across the entire body.
  2. Providing user guidance and instructions to assist with initial shortcut setup.
  3. Using intuitive methods (e.g., drag-and-drop and pointing selection) to place icons.

• What are the innovative aspects of this solution?

  1. Enabling shortcut distribution across the entire body surface using augmented reality technology, rather than limiting it to specific areas.
  2. Offering interactive guidance for personalized placement, enhancing user experience.
  3. Providing visual feedback and icon size options to improve operational flexibility and reduce error rates.
  4. Incorporating considerations of body movement habits, privacy, and aesthetic design to refine spatial interaction design.

• What are the implementation steps and key technologies used?
  The authors developed an AR glasses prototype based on the Unity engine, with the following steps:

  1. Tutorial experience: Users touch preset icons to intuitively experience the "On-body Icons" functionality.
  2. Initial setup: Users place application shortcuts on any body area using drag-and-drop or pointing selection methods.
  3. Functional feedback: Users launch designated shortcuts by touching their body.

Research Outcomes

• What specific outcomes were achieved?

  1. Participants exhibited highly personalized behaviors when placing shortcuts, based on natural body habits, associations, and aesthetic design.
  2. Areas such as hands, head/neck, and legs were most commonly chosen for placement, with users adjusting layouts based on frequency, privacy, and contextual needs.
  3. Users demonstrated diverse placement strategies, such as functional placement (e.g., music shortcuts near the ear), emotional considerations (e.g., hiding private apps), body habits, and unique features (e.g., elbows, joints).

• What advantages does it have compared to existing solutions?

  1. Compared to traditional menu-based operating systems, shortcut placement and access are more efficient, offering a smoother spatial interaction experience.
  2. Focuses on users' personalized needs, supporting shortcut placement across the entire body.
  3. Provides design improvements based on privacy and aesthetics, such as virtual mirroring functionality, auto-fading icons, and interactive feedback mechanisms.

• What were the experimental or evaluation results?

  1. Users successfully completed shortcut placement tasks based on body layouts, with most able to remember their chosen shortcut locations (average accuracy rate of 88%).
  2. Most participants expressed willingness to use this technology in the future and recognized its significant potential.
  3. During the experiment, users suggested several improvements, such as supporting widgets and refining icon triggering mechanisms.

• Limitations and Future Directions

  1. The sample size (24 participants) is limited, and the frequency and preference data may only serve as a reference, though the core strategies and design recommendations have strong generalizability.
  2. The experimental scenario (direct interaction between participants and experiment observers) may influence participant behavior, and further validation in real-world scenarios is needed.
  3. Future research could explore functional enhancements (e.g., multimodal input feedback) and adaptability for diverse user groups (e.g., users with limited physical abilities).

Through empirical analysis of user behavior, this paper thoroughly explores the design and application potential of "On-body Icons" in augmented reality, summarizing key ergonomic and cognitive strategies to provide significant practical and theoretical support for future spatial user interface design.