Augmented Reality Cues Facilitate Task Resumption after Interruptions in Computer-Based and Physical Tasks

Title of the Paper

Facilitating Task Resumption After Interruptions in Computerized and Physical Tasks Through Augmented Reality Cues

Bibliographic Information

• Subject Area: Augmented Reality (AR), Human-Computer Interaction (HCI), Task Interruptions
• Keywords: Task Resumption, Interruptions, Augmented Reality, Resumption Lag, Human Error

Research Background and Problem

• Identified Issues or Challenges: Task interruptions are frequent and unavoidable in many work domains, negatively impacting task efficiency, error rates, and worker satisfaction. However, effective methods to mitigate the impact of interruptions on task continuity remain an unresolved issue.
• Significance: Interruptions can lead to memory decay and increased errors during task resumption, with potentially severe consequences in time-critical scenarios such as healthcare and aviation.
• Research Motivation and Related Work: Although prior studies have explored the effects of various visual cues on task resumption, the potential of augmented reality (AR) technology in this context remains unclear. This study aims to fill this gap by evaluating the impact of AR cues on task resumption through two experiments.

Proposed Solution

• Proposed Method: This study employs head-mounted AR devices to provide visual cues (a red arrow) indicating the location of the task to be resumed.
  • Experiment 1: Compared user-initiated manual cues with system-automated tracking cues.
  • Experiment 2: Focused on more spatially complex physical tasks, evaluating the effect of automated cues in scenarios resembling medical tasks (e.g., medication sorting).
• Innovative Contributions:
  1. Theoretical support: Utilizing "goal memory theory" to explain the impact of interruptions on task resumption.
  2. Experimental task design: Combining classic paradigms for computerized task resumption with novel practical tasks to cover diverse scenarios.
  3. Effectiveness comparison: Evaluating manual versus automated cues to provide design guidelines for practical applications.
• Implementation Steps and Key Technologies:
  • Presenting visual cues via head-mounted devices (e.g., Microsoft HoloLens).
  • Measuring resumption lag and error rates under different conditions.
  • Designing computerized tasks and physical tasks (e.g., medication sorting) to analyze the effects of cues on resumption after short and long interruptions.

Research Findings

• Specific Results:
  1. AR cues (both automated and manual) significantly improved resumption lag and error rates after task interruptions in both computerized and physical tasks.
  2. The facilitation effect of task resumption was particularly pronounced after longer interruptions.
  3. No significant difference in resumption efficiency was observed between manual and automated cues.
• Advantages Over Existing Solutions:
  • Universality: AR cues demonstrated consistent advantages across task contexts (computerized and physical tasks).
  • Spatial Memory Support: AR's spatial cueing approach facilitated faster task localization and resumption.
• Experimental and Evaluation Results:
  • In Experiment 1 (computerized tasks), significant improvements were observed in resumption after long interruptions; short interruptions showed a "floor effect" due to easier recovery.
  • In Experiment 2 (physical tasks), cues significantly reduced resumption lag after both short and long interruptions.
  • The first action after resumption (edit lag) was not prolonged by cues, indicating that the cues effectively re-established task context during the resumption phase.
• Limitations and Future Directions:
  1. Limitations:
     • Task difficulty in the experiments was relatively low, which may not fully represent complex real-world work environments.
     • The cues demonstrated full reliability in the experiments, which might not hold under practical technical constraints.
     • Interruptions were limited to task boundaries, without exploring more complex scenarios (e.g., mid-task interruptions).
  2. Future Directions:
     • Investigate task resumption in more complex scenarios, such as multi-step guidance in manufacturing assembly tasks.
     • Test the reliability of automated tracking technology in real-world environments (e.g., healthcare settings).
     • Expand cue designs to include richer information (e.g., text or semantic data) for high-safety requirements.

Design Implications

1. Prioritize Automated Cues: Automated cues provide equivalent performance improvements and are more convenient for real-world applications.
2. Adopt Simple and Salient Cue Designs: The red arrow demonstrated strong generalizability across both computerized and physical task scenarios.
3. Adapt to Mobile Work Environments: Introduce visible AR cues (e.g., red arrows or icons) suitable for work scenarios requiring location transitions (e.g., healthcare).
4. Integrate with Task Guidance Systems: Incorporate cues into existing AR task guidance interfaces for more complex and safety-critical environments.

Conclusion

Augmented reality cues are an effective intervention to significantly mitigate the negative impact of task interruptions on efficiency and accuracy, particularly in environments with frequent interruptions (e.g., healthcare, aviation, and manufacturing). As AR devices become increasingly widespread, the findings of this study provide a foundation for leveraging visual cues to enhance user experience comprehensively.