“Where is history”: Toward Designing a Voice Assistant to help Older Adults locate Interface Features quickly

Document Title

“Where is history”: Toward Designing a Voice Assistant to Help Older Adults Locate Interface Features Quickly

Document Information

• Subject Area: Human-Computer Interaction (HCI), mobile device usability, voice interaction design
• Keywords: older adults, aging, design, mobile interface, accessibility, voice input, voice assistant

Research Background and Issues

• Problems and Challenges:

  • Older adults often struggle to quickly locate specific features on feature-rich mobile interfaces.
  • This issue is particularly pronounced in mobile applications with frequently updated visual layouts.
  • Existing design recommendations (e.g., tooltips or behavioral heatmaps) are mostly suited for desktop environments, while mobile devices have limited screen space.
  • Older users tend to rely on their expectations of feature locations rather than fully exploring the interface, leading to operational errors and hindered navigation.

• Significance:

  • As the adoption of mobile devices among older adults increases, addressing these issues can help bridge the digital divide between older adults and technology.
  • The growing importance of mobile devices in daily life means that the inability to use such technology effectively may impact the independence of older adults.

• Research Motivation and Related Work:

  • Exploring how to design a voice-query-based solution for older users to help them quickly locate interface features.
  • Existing literature has discussed the navigation difficulties of older users in desktop and mobile interfaces but has not delved deeply into solutions.
  • Research on voice interfaces indicates that older adults are more inclined to use voice assistants to find information, demonstrating some feasibility.

Solution

• Research Methodology:

  • Proposed a voice assistant design solution that provides visual cues in response to users’ natural language voice queries, helping them quickly locate features.
  • Utilized voice recognition and intent detection technologies to process user queries, combined with interface structure data to identify relevant features.
  • Employed the Wizard-of-Oz (WoZ) experimental method in design probes to simulate the actual interaction experience with the voice assistant.

• Innovations:

  • Proposed a voice-assisted design to address interface navigation challenges faced by older users, rather than traditional tutorial-based designs relying on manual guidance or page descriptions.
  • Combined real-time voice queries with visual feedback to enhance the efficiency and learning ability of older users in interface exploration.

• Implementation Steps:

  1. Users input queries through the voice assistant (e.g., “Where can I find the ‘history’ feature?”).
  2. Voice recognition technology extracts keywords from the user’s query.
  3. Extract labels and descriptive information of all UI components on the current page and match them with the extracted keywords.
  4. Highlight up to three UI components most relevant to the query.
  5. Provide visual feedback to help users locate the correct feature.

Research Outcomes

• Specific Outcomes:

  1. Identified five typical problem types faced by older users when encountering interface difficulties: verification issues, directional information queries, non-directional information queries, navigation issues, and conceptual issues.
  2. Developed a classification framework to describe the types of queries older users might make.
  3. Formulated voice assistant design requirements based on problem classification and conducted WoZ-based experimental evaluations.

• Comparative Advantages Over Existing Solutions:

  • Provides real-time assistance to reduce the scope of visual search rather than relying on pre-provided tutorials.
  • Compared to interaction tutorials that only offer operational instructions, this design is more lightweight and suitable for the limited screen space of mobile devices.

• Experiment and Evaluation Results:

  1. Experiments revealed that older users are more likely to use the voice assistant when in a state of disorientation (e.g., repeated incorrect or circular selections).
  2. After using the voice assistant, 77% of users were able to immediately return to the correct task path.
  3. Design probe studies indicated that older users found voice interaction designs relatively easy to accept and understand, though further optimization of visual feedback design is needed to reduce screen “clutter.”

• Limitations and Future Directions:

  • Limitations:
    • The feature location assistance is limited to the current page and cannot anticipate user needs across pages.
    • The accuracy of natural language recognition and intent processing in the voice assistant remains a constraint.
    • The current design does not fully address verification issues (e.g., users asking whether an action was performed correctly).
  • Future Directions:
    • Expand the design to support multi-page feature location and provide visualized interaction paths.
    • Optimize visual feedback design to reduce users’ cognitive load.
    • Explore methods for voice assistants to support other types of issues, such as verification problems.

This study provides a feasible support method for older adults to explore modern mobile interfaces while highlighting the need for further research to enhance the effectiveness of the design.