Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults to Explore and Learn Smartphone Applications

Title of the Paper

Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults Explore and Learn Smartphone Applications

Paper Information

• Thematic Area: The role of Augmented Reality (AR) technology in supporting older adults in learning smartphone applications
• Keywords: Augmented Reality, older adults, smartphone exploration, independent learning, digital literacy, AR design, user experience, human-computer interaction, multitasking, technology acceptance
• Conference Information: CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11–16, 2024, Honolulu, HI, USA
• DOI: 10.1145/3613904.3641901

Research Background and Problem Statement

• Problem:

  • The global trend of population aging requires older adults to adapt to a rapidly changing digital environment. However, many older adults face physical and cognitive challenges when learning and using complex smartphone applications.
  • Older adults' learning is affected by factors such as the digital divide and declining cognitive and physical abilities, limiting them to basic smartphone functions (e.g., calls, messaging), which significantly restricts the potential of technology.
  • Although AR technology can enhance user experience and facilitate learning, its potential in supporting older adults' smartphone learning has not been fully explored.

• Significance:

  • Mastering digital technology has a significant impact on older adults' social connections and mental health, such as reducing loneliness and improving quality of life.
  • Current research and practices still have significant limitations in supporting older adults' independent learning of technology.

• Research Motivation:

  • Exploring how to effectively design and utilize AR support tools from the perspective of older adults to alleviate physical and cognitive burdens in smartphone learning can contribute to the development and adoption of related technologies in the future.

• Research Questions (RQs):

  1. How can AR support older adults in independently exploring and learning smartphone applications?
  2. In what ways do older adults expect to interact with AR to better explore and learn smartphone applications?

Proposed Solution

• Methodology:

  1. Phase One: Conducted workshop studies with 18 older adults to identify challenges in smartphone application learning and explore potential AR intervention points.
  2. Phase Two: Employed the "technology probe" method to conduct participatory design-based collaborative dialogues and co-develop AR support tools.

• Innovations:

  • Systematically introduced AR into the field of older adults' smartphone learning for the first time, using a two-phase research design to clarify AR's potential role and user interaction preferences.
  • Proposed design considerations tailored to older adults' needs, such as trial-and-error support, safe previews, and hidden feature explanations.
  • Integrated AR's advantages with older adults' concerns about digital security, accessibility, and other issues into the design framework.

• Key Technologies and Implementation:

  • Developed AR demonstration devices using Microsoft HoloLens 2 and implemented core functionalities with Unity.
  • Designed various AR features, including font magnification, hidden feature highlighting, companion virtual assistants, and contextual information previews.
  • Leveraged the "technology probe" method to collect user interaction data and expand the breadth and flexibility of the design.

Research Outcomes

• Key Findings:

  • AR significantly reduced the cognitive and physical burden on older adults during multi-application switching and trial-and-error processes.
  • Older adults found features such as screen magnification, hidden content display, and trial-and-error sandboxes effective in reducing operational difficulties.
  • Interaction preferences were ranked as follows: touch, eye-tracking, and virtual light pointers, indicating that AR systems need to draw more from smartphone interaction methods familiar to older adults.
  • Based on older adults' suggestions, AR content should allow users to control when to execute actions, such as "clicking" to highlight hidden content instead of automatic display.

• Comparative Advantages Over Existing Solutions:

  • Supplemented existing technological interventions, such as traditional step-by-step guides or static video aids, with AR's dynamic, immersive, and real-time feedback capabilities.
  • Design principles focused more on older users' psychological comfort and personalized needs.

• Experimental or Evaluation Results:

  • The majority of participating older adults expressed satisfaction with the AR experience and features, though concerns were raised about device weight and wearing comfort.
  • Users expressed worries about high costs and large device sizes, suggesting promotion through cost reduction or shared device usage.

• Limitations and Future Directions:

  • Limitations: The sample group was concentrated on older adults with a higher degree of technology acceptance, excluding a broader population with lower technological exposure.
  • Future Directions:
    1. Explore more collaborative learning scenarios between older adults and AR.
    2. Enhance the ergonomic design and affordability of AR devices.
    3. Introduce AR into social learning dimensions and evaluate its long-term impact on older adults' health and well-being.