Recentering Reframing as an RtD Contribution: The Case of Pivoting from Accessible Web Tables to a Conversational Internet

Title of the Paper

Recentering Reframing as an RtD Contribution: The Case of Pivoting from Accessible Web Tables to a Conversational Internet

Paper Information

• Domain: Human-Computer Interaction (HCI) and Design Research
• Keywords: Research through Design, reframing, drifting, design experiment, design research program, accessibility, visually impaired, conversational internet

Research Background and Problem

• Problem or Challenge: Current design research literature lacks substantial descriptions of how reframing emerges from design experiments, particularly how design research leads to significant pivots in research direction. Additionally, there are shortcomings in addressing user needs concerning screen reader accessibility for web tables.
• Significance: Reframing is a critical contribution of design research, capable of addressing "wicked problems" that scientific or engineering methods struggle to resolve. Explicitly documenting this process can help design research avoid being dismissed as "romantic design"—relying solely on "inspired genius."
• Related Work and Motivation:
  • Design theory has discussed reframing as a unique outcome of design action, but explicit exploration in RtD contexts remains rare.
  • HCI research often focuses on improving website accessibility, particularly for visually impaired users, but has not deeply explored innovative ways to meet their information needs.

Solution

• Proposed Approach: The authors detail the research process through three design experiments, demonstrating how reframing shifted the focus from improving web table accessibility to supporting the broader concept of a "Conversational Internet." This transition involved moving from table navigation research to designing information and applications optimized for voice interaction.
• Innovations:
  1. Introducing the "Conversational Internet" as a new core framework for design research, emphasizing voice-optimized content over visual design to better serve visually impaired users.
  2. Highlighting the importance of documenting and reflecting on design experiments to capture the gradual reframing process.
• Implementation Steps and Techniques:
  1. Design Experiment 1: Evaluating technologies to enhance web table navigation by reformatting table content for screen reader users.
  2. Design Experiment 2: Investigating the performance of current voice assistants (e.g., Siri, Google Home) in answering table-related information queries, analyzing question types and answer quality.
  3. Design Experiment 3: Deploying Google Home devices to visually impaired users, recording their usage behaviors and feedback to explore practical applications of voice-based Q&A.

Research Outcomes

• Specific Findings:
  1. Current screen reader navigation improves table information retrieval but fails to address users' core need for direct answers.
  2. Establishing the "Conversational Internet" as a superior goal, redefining internet services through voice-optimized content and conversational interaction design.
• Advantages:
  • Compared to traditional web content reading optimization, voice-interactive design better meets the needs of visually impaired users and has potential applications in other scenarios (e.g., driving, cooking).
• Experimental Results:
  • Tests show that current voice assistants effectively answer simple questions but struggle with complex queries and in-depth information.
  • Deployment experiments reveal visually impaired users' strong demand for voice systems and their desire for deeper information access.
• Limitations and Future Directions:
  • Challenges remain in the cost and scalability of generating conversational internet content.
  • Future research should focus on developing "killer applications" and establishing reusable conversational design patterns for industry adoption.

Conclusion and Reflection

• Through case studies, the authors highlight that reframing is a gradual and iterative process deserving greater attention and documentation within the design research community.
• The paper not only provides new directions for HCI accessibility research but also supports a shift in design research from "romanticism" to "pragmatism," emphasizing design as a collaborative and incremental knowledge-generation process.
• The authors advocate for design research to document reframing processes and accumulate case studies to build a more robust research model and theoretical foundation.