Dementia Eyes: Co-Design and Evaluation of a Dementia Education Augmented Reality Experience for Medical Workers

Title of the Paper

Dementia Eyes: Co-Design and Evaluation of a Dementia Education Augmented Reality Experience for Medical Workers

Bibliographic Information

• Subject Area: Application of Augmented Reality (AR) technology in medical education, particularly in dementia care education.
• Keywords: Dementia, Education, Augmented Reality, Experience-Oriented Design, Human-Computer Interaction

Research Background and Problem Statement

• Identified Problems/Challenges:

  1. Dementia patients exhibit Behavioral and Psychological Symptoms of Dementia (BPSD), but global care services face significant challenges such as high costs, time consumption, insufficient expert support, and lack of standardized protocols.
  2. Medical workers lack professional knowledge and practical experience in dementia care, which may lead to symptom deterioration.
  3. Although technologies like online courses and blended learning approaches have been explored in dementia education, the design and implementation of XR (Extended Reality) technologies to simulate the experiences of dementia patients remain unclear, with a gap between design and user needs.

• Significance of the Research:

  1. The quality of dementia patient care is directly related to the professional knowledge and skills of caregivers.
  2. Improved medical education can alleviate BPSD symptoms, thereby enhancing the quality of life for patients.
  3. The immersive experience provided by XR technology can complement existing care training methods, helping medical workers understand patient experiences from their perspective.

• Motivation and Related Work: The authors aim to address gaps in current dementia education using XR technology, focusing on how to design XR systems to meet caregiver needs and how to evaluate the effectiveness of XR educational programs.

Proposed Solution

• Proposed Approach: The authors designed an Augmented Reality (AR)-based experiential system to help medical workers simulate the daily life experiences of dementia patients, enabling them to understand patients' challenges through sensory modalities such as vision and hearing.

• Innovative Aspects:

  1. Utilization of a First-Person Perspective (FPV) to help medical workers experience the sensory and cognitive changes of dementia patients.
  2. Use of AR technology to provide real-time environmental changes closely related to medical scenarios, enhancing the contextual realism of education.
  3. Adoption of a phased design and evaluation process, developed in collaboration with stakeholders in dementia care, emphasizing user-centered design.

• Implementation Steps and Key Technologies:

  1. Phase I: Understanding dementia care experiences from the perspective of medical workers and exploring the feasibility of XR technology implementation through surveys and workshops to gather feedback.
  2. Phase II: Designing prototypes based on feedback from Phase I, including both VR and AR solutions, and creating visual and auditory content using the Unity engine.
  3. Phase III: Conducting comprehensive evaluations of the revised AR prototype, analyzing its impact on medical workers' empathy, emotional responses, and self-reflection through questionnaires and interviews.

Research Outcomes

• Specific Achievements:

  1. Designed and implemented a low-fidelity AR prototype system that simulates visual and auditory changes experienced by dementia patients (e.g., darkened vision, difficulty in color perception, auditory orientation challenges).
  2. Findings indicate that the system can evoke empathy in medical workers towards dementia patients and enhance their reflective caregiving behaviors.
  3. Medical workers provided positive feedback on the system's simplicity and efficiency, suggesting its integration into practical educational settings.

• Advantages Over Existing Solutions:

  1. Compared to traditional educational methods, AR offers an immersive experience with real-time interaction and sensory changes, closely approximating the real-life context of dementia patients.
  2. Emphasizes daily interactions between medical workers and patients, promoting the development of health care-related technologies.

• Experimental or Evaluation Results:

  1. Questionnaire evaluations revealed significant improvements in participants' empathy across three dimensions (emotional, cognitive, and relational).
  2. Participants generally acknowledged the realism of the simulated experience and the effectiveness of short-term training.
  3. Some negative emotions (e.g., discomfort and anxiety) were reported but did not substantially affect learning outcomes.

• Limitations and Future Directions:

  1. The sample size was relatively small, with only 5 participants involved in the prototype design phase and 16 completing the final evaluation.
  2. Dementia symptoms are complex and diverse; the current system focuses only on sensory changes in early to mid-stage Alzheimer's Disease (AD).
  3. The system could be expanded in the future to include tools for optimizing care environments, such as improving home and hospital settings for dementia patients.
  4. Long-term follow-up studies are needed to evaluate the system's real impact on improving care service quality.

Through this research, the authors have laid the foundation for future development of dementia education and care support technologies, proposing an innovative approach to enhance medical education and understanding of patient experiences through technology.