"This machine is for the aides": Tailoring Voice Assistant Design to Home Health Care Work

Title of the Paper

"This machine is for the aides": Tailoring Voice Assistant Design to Home Health Care Work

Paper Information

• Subject Area: Human-Computer Interaction and the design and application of voice assistants in home health care work
• Keywords: Interactive Voice Assistant (IVA), Home Care, Digital Health, Privacy Protection, Information Transparency, Human-Centered Computing

Research Background and Issues

• Identified Problems and Challenges:

  • Home health care work is complex and diverse, involving patient life care, medical care, and coordination with doctors and institutions.
  • Existing tools for home care aides are generally inadequate, mismatched with work demands and privacy environments. Current technologies (e.g., smartphones and commercial voice assistants) often raise issues of privacy, efficiency, and acceptance.
  • Home care aides operate within a complex power dynamic between clients (patients and family members) and the healthcare system, making it difficult to balance privacy, compliance, and collaboration.

• Significance of the Research:

  • With the aging population increasing, the demand for home care for elderly clients is growing, necessitating new technological tools to optimize care work.
  • Voice assistants have been widely adopted in home settings but have not been specifically designed for home care work.
  • The importance of privacy, security, and multi-party collaboration in home health care requires further exploration to guide the design of new technological tools.

• Motivation and Related Work:

  • Previous studies suggest that technologies like voice assistants have potential in home care but often lack specialized design and functionality.
  • Home care aides tend to prefer tools designed specifically for their work context rather than entertainment or general-purpose devices.
  • Existing commercial voice assistants face challenges such as insufficient multilingual support, privacy risks, and insensitivity to users' cultural practices.

Proposed Solution

• Proposed Solution:

  • Designed two customized interactive voice assistants (IVAs): a Health Kit resembling a medical box and a Home Kit integrated into the home environment.
  • Developed a specialized software application, Home Health Agent, to provide visual and voice support for aides, assisting with daily tasks and medical assessments.

• Innovative Features:

  • Device designs tailored to home care work scenarios, emphasizing professional and home-friendly characteristics respectively.
  • The software application focuses on home care needs, supporting care plan management and medical assessment tasks, with an emphasis on multimodal (voice and visual) interaction.
  • Utilized Wizard-of-Oz technology to simulate more natural voice interactions, avoiding usability challenges posed by current technologies.

• Implementation Steps and Key Technologies:

  1. Physical Design: Developed two device forms, ensuring consistency in size, weight, and internal storage, while designing for portability and physical open/close mechanisms to signal the device's operational status.
  2. Software Development: Designed a conversational system to support daily task logging and medical assessment processes, enabling both visual and voice interactions.
  3. User Research: Conducted qualitative studies (25 home care aides and 7 client users), combining voice interaction tasks with semi-structured interviews to evaluate device acceptance, privacy, and collaboration effectiveness.

Research Outcomes

• Specific Findings:

  1. Advantages of Multimodal Interaction: The devices' voice and visual support helped aides complete tasks more effectively and enhanced transparency and trust in task scenarios with clients.
  2. Privacy and Control Mechanisms: The physical state of the device (open/close) was intuitively understood as "listening" or not, improving clarity in privacy control.
  3. Collaboration Potential: IVAs facilitated cross-shift collaboration among aides, aiding in patient data tracking and task prioritization.
  4. Device Design and Scenario Adaptation: The Health Kit was more professional, while the Home Kit blended better into home environments, catering to different client needs.

• Advantages Over Existing Solutions:

  • Custom-designed physical forms and scenario-specific functionalities increased acceptability.
  • Multimodal design achieved breakthroughs in enhancing transparency and supporting multilingual user groups.
  • The use of Wizard-of-Oz testing methods deeply explored the potential for more advanced voice interaction features.

• Experimental and Evaluation Results:

  • Home care aides generally found specialized tools more suitable for their work scenarios compared to smartphones or general-purpose devices.
  • Clients' acceptance of the devices was influenced by privacy protection and the enhancement of their autonomy in daily life.

• Limitations and Future Directions:

  • Limitations:
    • The current study was conducted in a laboratory setting, and the long-term effects in real home environments require further testing.
    • While the Wizard-of-Oz method demonstrated technological potential, it remains uncertain whether similar results can be achieved in commercial applications.
  • Future Directions:
    • Explore better balance between device physical design and privacy mechanisms.
    • Design smarter interaction methods that can automatically adapt to different user needs.
    • Integrate the devices into local healthcare ecosystems to support larger-scale pilot applications.