Can Icons outperform Text? Understanding the Role of Pictograms in OHMD Notifications

Document Title

Can Icons Outperform Text? Understanding the Role of Pictograms in OHMD Notifications

Document Information

• Subject Area: Human-Computer Interaction and Information Visualization, specifically the design of notifications for Optical Head-Mounted Displays (OHMD).
• Keywords: OHMD, Optical Head-Mounted Display, Icon Notifications, Multitasking, Information Design, Human-Computer Interaction, Graphics vs. Text Comparison, Focused Attention, Information Interruption, User Study.

Research Background and Issues

• Issues and Challenges:
  • Optical Head-Mounted Displays (OHMD), such as smart glasses, offer digital assistance anytime and anywhere. However, in mobile multitasking scenarios, users have limited attentional resources, posing new demands on information presentation.
  • Current information displays on OHMDs primarily use text (language) or pictograms (graphics). Although previous research has demonstrated the advantages of pictograms for rapid recognition in non-digital contexts such as road signs, their effectiveness in digital notifications remains inconclusive.
• Significance:
  • Designing OHMD notifications requires ensuring concise information presentation while enabling efficient processing in multitasking scenarios. This is crucial for enhancing user experience and optimizing multitasking performance.
• Research Motivation and Related Work:
  • While icons (pictograms) have effectively promoted rapid comprehension in many non-digital fields, cross-domain studies reveal mixed results for their application in digital notifications.
  • Previous research has not clearly elucidated the differences between text and pictograms on OHMDs, particularly when balancing interruption, reaction time, and comprehension.

Solution

• Proposed Solution:
  • Introduce "Icon-Augmented Notifications," which partially replace text notifications with icons to explore their potential in multitasking scenarios.
• Innovations:
  • Investigate the impact of icon familiarity, encoding density (the amount of text an icon can represent), and environmental brightness on the effectiveness of icon notifications.
  • Provide a mechanism for users to dynamically select icons to control biases related to content familiarity.
• Implementation Steps and Key Techniques:
  • Design and conduct a series of experiments:
    • Experiment 1: Compare researcher-selected icon-augmented notifications with text notifications in multitasking performance.
    • Experiment 2: Control conjunctions and filler words in text notifications to redesign the text baseline and minimize variable interference.
    • Experiment 3: Allow users to select familiar icons and explore the impact of encoding density.
    • Experiment 4: Test the real-world applicability of laboratory findings in practical environments.

Research Outcomes

• Specific Findings:
  1. Icon-augmented notifications reduce user interruptions in multitasking scenarios while maintaining efficient reaction times and attention performance.
  2. Users prefer icon-augmented notifications, especially when designed under the following conditions:
     • Users are highly familiar with the icons.
     • Icons have high encoding density (i.e., can represent more textual content).
  3. Experiment 4 demonstrates that these laboratory results have a degree of generalizability in real-world contexts, particularly in scenarios such as outdoor navigation and stationary browsing.
• Advantages:
  • Compared to traditional text notifications, icon-augmented notifications significantly reduce interruptions and lower the cost of attention shifts.
  • Icon notifications achieve efficient information transmission with minimal screen usage.
• Experiments and Evaluation:
  1. Experiment 1 found that icon-augmented notifications outperform text notifications in task accuracy and reaction time.
  2. Experiment 2 indicated that removing filler words from text notifications narrowed the advantage of icon notifications, but users still showed subjective preference for icons.
  3. Experiment 3 confirmed that user-selected icons enhance notification interpretability and validated the potential of icons to support multilingual communication through encoding density.
  4. Experiment 4 revealed the high adaptability of icon notifications in real-world environments but also highlighted the impact of external brightness on notification visibility.
• Limitations and Future Directions:
  • Limitations include the focus on daily calendar notifications, which may restrict applicability to other types of notifications (e.g., instant messaging app notifications).
  • Further research is needed on environmental brightness, notification contrast in outdoor conditions, and long-term usage habits.
  • Future research directions include:
    • Exploring automated design systems for icon-augmented notifications.
    • Expanding applicability studies to broader notification types and user groups (e.g., older adults, visually impaired individuals).
    • Integrating innovative technologies such as eye-tracking to further optimize notification design and presentation.

Output Specifications

• Overall Format: Combine text and graphical notifications to enhance user experience in future augmented reality devices.
• Application Recommendations: Icon-augmented notifications are particularly suitable for scenarios requiring rapid recognition and brief responses (e.g., outdoor navigation, personal schedule reminders).