Mind the Kayak! Informing UX Design of Autonomous Vehicles through Edge Case Testing in the FieldAs autonomous vehicles are being deployed in the field for public use, passengers are interacting with traffic in new ways. In recent years, user experience related to risky traffic interactions has been studied using virtual simulations, desktop studies, and surveys—yet field tests have remained out of reach. In this paper, we present results from a field test of an autonomous urban passenger ferry open to public use. Specifically, we investigate two questions: (i) are passengers' safety perceptions negatively affected by interactions with risky traffic? and (ii) can simulating risky behavior in the field (so-called "adversarial evaluation") present a viable way to study user experience? After repeatedly sending a kayaker on a collision course with the ferry (N~=~20 interventions), we sampled naïve passengers about their experiences (intervention group; N~=~37) and compared the result to those who experienced a normal crossing (control group, N~=~178). The results favored the intervention group, which scored higher in safety perception. However, the latter also reported that there is a need for more feedback about the ferry's current state and future intentions to avoid surprises both for passengers and for other traffic. As autonomous vehicles are field-tested and deployed, the study reflects a growing need to test user experience in the operational environment. We discuss implications for design, emphasizing the use of external human-machine interfaces (eHMIs) and special considerations for the maritime domain.2025OAOle Andreas Alsos et al.Norwegian University of Science and Technology, Department of DesignAutomated Driving Interface & Takeover DesignExternal HMI (eHMI) — Communication with Pedestrians & CyclistsCHI
Facilitation Skills in Participatory DesignThe democratic and emancipatory principles underpinning Participatory Design (PD) set PD methodology apart from other user-oriented design methodologies associated with Human-Computer Interaction. In turning PD principles into practice, PD facilitators play a vital role. However, at present, there is a lack of understanding regarding skills relevant to enacting the role. To address this issue, we present the results from an interview study involving fourteen respondents with considerable PD facilitation experience. The analysis of the interviews uncovered six facilitation skills of perceived relevance: openness, patience, empathy, attentiveness, responsiveness, and adaptiveness. The significance of each skill, as expressed by respondents, is accounted for. We further discuss the composition of skills in the derived skill set, possible implications of missing skills, and how the findings complement relevant existing work. Drawing on the findings, the paper offers an empirically based qualitative understanding of what constitutes skillful PD facilitation.2025YDYngve Dahl et al.NTNU, Department of Computer ScienceParticipatory DesignCHI
Exploring VUI-Supported Mindfulness Techniques for Smoking CessationThis study investigates the effectiveness of Voice User Interfaces (VUIs) in supporting mindfulness techniques for smoking cessation. We conducted a month-long between-subject study involving nine participants, comparing a VUI on smart speakers against an augmented VUI (a blend of VUI and Graphical User Interface) on mobile devices. Specifically, we evaluated how these interfaces support individuals in quitting smoking through mindfulness practices. Our results include qualitative insights on participants' experiences with mindfulness, their smoking cessation motivation, and engagement with the VUI prototypes, alongside quantitative data on their usage patterns. Our findings offer insights into the potential application of VUIs in smoking cessation and suggest design guidelines for future health-oriented applications. The study underscores the importance of device context in designing effective health interventions and sets the direction for future work in HCI and mindfulness applications.2024SKSimon Bak Kjaerulff et al.Voice User Interface (VUI) DesignMental Health Apps & Online Support CommunitiesCUI
"Please Be Nice": Robot Responses to User Bullying - Measuring Performance Across Aggression LevelsAs robots become integral to public services, addressing harmful user behaviors like bullying is crucial. Existing research often overlooks the gradual nature of human bullying. This study fills this gap by exploring how robots can counter bullying through optimized responses. Using a simulated human-robot interaction study, we manipulated robot response behaviors and styles across escalating bullying severity. Results show that empathetic verbal responses promptly reduce users' bullying tendencies by eliciting remorse and redirecting attention to social awareness. However, users' underlying dispositions may override these reflexive reactions, emphasizing the need for a holistic understanding. In conclusion, a comprehensive approach is essential, involving immediate reaction optimization, emotional state assessment, and ongoing behavioral adjustment through empathetic dialogue. By implementing such strategies, we can transform human-robot relationships from potential bullying situations to harmonious interactions. This study provides an empirical foundation for response protocols that discourage bullying and enhance mutual understanding.2024YLYiming Luo et al.Xian UniversitySocial Robot InteractionCHI
Exploring Humor as a Repair Strategy During Communication Breakdowns with Voice AssistantsVoice assistants are becoming increasingly useful and support realistic conversations, yet communication breakdowns occur. We investigate the use of humor as a repair strategy in an experiment where the voice assistant makes a mistake and then utilizes one of four humorous personalities to repair the breakdown in the conversation. We conducted a study with 30 participants, each of whom took the Humor Style Questionnaire (HSQ) to understand their predisposition to humor type, and then engaged in conversation with each of the four humorous personalities and one that was designed to give neutral repair responses (non-humorous). Aggressive personalities were rated as the funniest, yet there was no clear connection between the participant's humor style and their preferred voice assistant personality. While humorous responses were successful in repairing communication breakdowns, participants overall preferred non-humorous responses. This research provides insight into the role of humor in communication breakdown repair with voice assistants.2023MCMikkel Clausen et al.Intelligent Voice Assistants (Alexa, Siri, etc.)Agent Personality & AnthropomorphismCUI
Automation Transparency: Designing an External HMI for Autonomous Passenger Ferries in Urban WaterwaysAutomation transparency – the visibility of responsibilities, capabilities, goals, activities, and effects of autonomous systems – is not only important for the operator, but also relevant for other humans in the system’s environment. This pictorial investigates current trends in the development of External Human-Machine Interfaces (eHMIs) and highlights the most important factors for designing eHMIs. Further, it explores automation transparency for a self-driving passenger ferry for urban waterborne transport and how it can communicate messages about the system’s perceptions, current state and future intention to nearby ships and bystanders through an eHMI. As a result of a user-centred design process, we propose a unique eHMI design making an urban autonomous passenger ferry capable of expressing its state and intention to nearby ships and humans via displays, light, and moving panels. The results of this paper can inform designers of the importance of automation transparency for autonomous waterborne transport systems.2023VSVedran Simic et al.External HMI (eHMI) — Communication with Pedestrians & CyclistsPublic Transit & Trip PlanningDIS
Towards Designing Playful Bodily Extensions: Learning from Expert InterviewsInteractive technologies offer novel opportunities for physically extending our bodies, with the most prominent examples being prosthetics along with systems emerging from the wearables community. However, most such systems appear to focus on instrumental benefits, missing out on the opportunity to use bodily extensions for play and its associated benefits (including a lower adoption barrier and the potential to reveal a broader understanding of such technologies). To begin understanding the design of playful bodily extensions, we interviewed five designers of bodily extensions that have been showcased in prestigious academic venues or turned into commercial products. Here we present themes and actionable advice from these interviews for the design of playful bodily extensions through a thematic analysis. Our work aims to support the design of future playful bodily extensions while promoting the experiential qualities of bodily extension design, with the ultimate goal of bringing more playful experiences to people’s lives.2023OBOğuz 'Oz' Buruk et al.Tampere UniversityShape-Changing Interfaces & Soft Robotic MaterialsFull-Body Interaction & Embodied InputCHI
Defining Patterns for a Conversational WebConversational agents are emerging as channels for a natural and accessible interaction with digital services. Their benefits span across a wide range of usage scenarios and address visual impairments and any situational impairments that may take advantage of voice-based interactions. A few works highlighted the potential and the feasibility of adopting conversational agents for making the Web truly accessible for everyone. Yet, there is still a lack of concrete guidance in designing conversational experiences for browsing the Web. This paper illustrates a human-centered process that involved $26$ blind and visually impaired people to investigate their difficulties when using assistive technology for accessing the Web, and their attitudes and preferences on adopting conversational agents. In response to the identified challenges, the paper introduces patterns for conversational Web browsing. It also discusses design implications that can promote Conversational AI as a technology to enhance Web accessibility.2023EPEmanuele Pucci et al.Politecnico di MilanoIntelligent Voice Assistants (Alexa, Siri, etc.)Conversational ChatbotsVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)CHI
Six Facets of Facilitation: Participatory Design Facilitators’ Perspectives on Their Role and Its RealizationParticipatory design facilitators have a significant impact on participatory activities, processes, and outcomes. However, the facilitator role has not yet been thoroughly debated in existing design discourse, and support for role-related reflections is limited. As the first steps towards an enriched collective understanding of this specific role and its realization, we interviewed 14 respondents with an academic background in participatory design and extensive facilitation experience. Based on a content analysis of the interviews, we identified six facets of the role: (1) trust builder, (2) enabler, (3) inquirer, (4) direction setter, (5) value provider, and (6) users’ advocate. Each facet is presented as consisting of the respondents’ perceived associated responsibilities and corresponding strategies. Our results paint a complex picture of participatory design facilitation. We propose the multi-faceted understanding of the facilitator role emerging from this work as a basis for problematized reflection on the role and its realization.2022YDYngve Dahl et al.NTNUParticipatory DesignCHI
Restraints as a Mechanic for Bodily PlayThis paper presents restraints - directly imposed restrictions on players' bodily movements, as a mechanic for bodily play in HCI. While this is a familiar mechanic in non-digital movement-based games, its potential in designing bodily play experiences in HCI has been scarcely explored. Three types of restraints observed in non-digital movement-based games, are explored here: fixating body parts, excluding body parts and depriving/manipulating bodily senses. Then, we investigate the experiential dynamics of restraints as a bodily play mechanic bridging a phenomenological perspective on bodily movement with theories on play. These investigations form the theoretical framework for the subsequent analysis of five digital body game examples. Building on this analysis and theoretical framework, we formulate five design strategies for implementing restraints as a mechanic for bodily play in HCI. We propose restraints as a generative resource for researchers and designers interested in understanding and designing bodily play experiences in HCI.2021LMLouise Petersen Matjeka et al.Norwegian University of Science and TechnologyVibrotactile Feedback & Skin StimulationFull-Body Interaction & Embodied InputFoot & Wrist InteractionCHI
Design for change with and for children: how to design Digital StoryTelling tool to raise stereotypes awareness.Gender stereotyping in child development and education is a known issue but as yet little attention has been given to the design for change, or at least attenuate, stereotypical thinking. In our research we explored how Digital StoryTelling (DST) could support children in their awareness of negative gender stereotypes. Following a participatory design-inspired approach we involved 43 participants; children and adults (teachers and experts in the domain), in three workshops with the purpose of exploring this design space. Here, we describe this full process and its outcomes: nine concepts to guide the design of a DST tool. The workflow and toolbox used during the process are instances of an approach that could be replicated in other contexts and/or to challenge other types of stereotypes. The main contribution of our research is towards the design for change with and for children. We hope that our work will inspire members of our community to address these issues.2020ERElisa Rubegni et al.STEM Education & Science CommunicationParticipatory DesignDIS
Facilitating Democracy: Concerns from Participatory Design with Asymmetric Stakeholder Relations in Health CareThis paper addresses how facilitation can implicate what, whose and how perspectives and values become embedded in the results from participatory design activities. Inspired by Donald Schön's reflection-on-action theory, an analysis of our facilitator performances in three design activities involving health care stakeholder groups with asymmetric relations has been performed. The analysis highlights the often subtle and unforeseen ways by which facilitator actions influence who "has a say". The results emphasize how continuous introspective analyses and reflections may improve the facilitator's attentiveness to actions that may inadvertently impede the disfavored party. In the long-term, neglect may threaten the integrity of participatory design as a democratic and empowering design approach. The shift towards a practice-perspective on facilitation goes beyond the efforts of the individual practitioner. The cultivation of the reflective facilitator, a concern of relevance for the Human–Computer Interaction and Participatory Design community as a whole, is considered.2020YDYngve Dahl et al.Norwegian University of Science and TechnologyEmpowerment of Marginalized GroupsParticipatory DesignCHI
Next Steps for Human-Computer IntegrationHuman-Computer Integration (HInt) is an emerging paradigm in which computational and human systems are closely interwoven. Integrating computers with the human body is not new. however, we believe that with rapid technological advancements, increasing real-world deployments, and growing ethical and societal implications, it is critical to identify an agenda for future research. We present a set of challenges for HInt research, formulated over the course of a five-day workshop consisting of 29 experts who have designed, deployed and studied HInt systems. This agenda aims to guide researchers in a structured way towards a more coordinated and conscientious future of human-computer integration.2020FMFlorian Floyd Mueller et al.Monash UniversityBrain-Computer Interface (BCI) & NeurofeedbackTechnology Ethics & Critical HCIUser Research Methods (Interviews, Surveys, Observation)CHI
The Designer's Body as Resource in Design: Exploring Combinations of Point-of-view and TenseThe design of wearable, tangible and embedded interactive products requires a focus on bodily/kinesthetic aspects of the user experience, that is, how the product "feels" in use. Although best practice in user-centered design (such as iterative design, prototyping, user testing) also applies for this new type of product, the designer's skill set needs to be supplemented with design methods and practices that utilize bodily intelligence and empathy with the user. We present a framework for categorizing such body-centered design practices based on two dimensions: point-of-view (1st, 2nd, 3rd person) and tense (past, present, future). Inspired by Merleau-Ponty's phenomenology of the body, Shusterman's work on somaesthetics, and Buber's theories on intersubjectivity, the framework provides a language for talking about different ways designers and co-designers can utilize their body as a design resource. The intention is not to be prescriptive on method, but to provide guidance during planning, execution and analysis.2020DSDag Svanaes et al.Norwegian University of Science and Technology & IT-University of CopenhagenHaptic WearablesPrototyping & User TestingCHI
Would you do it? Enacting Moral Dilemmas in Virtual Reality for Understanding Ethical Decision-MakingA moral dilemma is a decision-making paradox without unambiguously acceptable or preferable options. This paper investigates if and how the virtual enactment of two renowned moral dilemmas---the Trolley and the Mad Bomber---influence decision-making when compared with mentally visualizing such situations. We conducted two user studies with two gender-balanced samples of 60 participants in total that compared between paper-based and virtual-reality (VR) conditions, while simulating 5 distinct scenarios for the Trolley dilemma, and 4 storyline scenarios for the Mad Bomber's dilemma. Our findings suggest that the VR enactment of moral dilemmas further fosters utilitarian decision-making, while it amplifies biases such as sparing juveniles and seeking retribution. Ultimately, we theorize that the VR enactment of renowned moral dilemmas can yield ecologically-valid data for training future Artificial Intelligence (AI) systems on ethical decision-making, and we elicit early design principles for the training of such systems.2020ENEvangelos Niforatos et al.Norwegian University of Science and TechnologyImmersion & Presence ResearchAI Ethics, Fairness & AccountabilityCHI
Ethics in Movement: Shaping and Being Shaped in Human-Drone InteractionHow is ethics shaped by the particularities of a design? Through a detailed video analysis, we explore how ethicality is shaped in interaction between a choreographer, a performer and a choir of five drones, performing together on the opera stage. We pinpoint how movements enabled by the human-drone assemblage may limit or liberate artistic expressions vis-à-vis the norms of operatic performance. From a somaesthetics perspective on ethics, we show how the process of crafting rich experiences together with drones can deepen sensory appreciation skills, leading to an increased understanding of underlying somatic drivers and imposed norms. Somatic awareness thereby enables a richer repertoire of movements, expanding the ability to freely choose how to act, and cultivating empathy towards others. This shifts our understanding of ethics in HCI as solely about abstract rules or policies 'out there' to also concern the specifics of how technology informs or dictates movement and experience.2020SESara Eriksson et al.Stockholm UniversityDrone Interaction & ControlTechnology Ethics & Critical HCIDance & Body Movement ComputingCHI
Data Handling in Knowledge Infrastructures: A Case Study from Oil ExplorationOil exploration is concerned with subsea geological reservoirs that are numerous kilometers below the seabed. These reservoirs are knowable only through a knowledge infrastructure of interconnected technologies that are applied to diverse instrument-generated data. Noise, holes, and inaccuracies are inherent in the data, which depend on the technology producing it. We conducted an interpretative case study of data handling work in the exploration unit of a European oil company. Our findings show how data handling involves the skills needed for managing data identities and ownership, a variety of technologies, and contingent negotiations of data needs. We use the notion of repair to analyze this data handling work and discuss how the concept of repair in data handling involves keeping the knowledge infrastructure navigable and attending to countless details. Our research contributes to the literature on repairing infrastructures by considering how repair relates to data work.2018MMMarius Mikalsen et al.Data in Diverse SettingsCSCW