Varif.ai to Vary and Verify User-Driven Diversity in Scalable Image GenerationDiversity in image generation is essential to ensure fair representations and support creativity in ideation. Hence, many text-to-image models have implemented diversification mechanisms. Yet, after a few iterations of generation, a lack of diversity becomes apparent, because each user has their own diversity goals (e.g., different colors, brands of cars), and there are diverse attributions to be specified. To support user-driven diversity control, we propose Varif.ai that employs text-to-image and Large Language models to iteratively i) (re)generate a set of images, ii) verify if user-specified attributes have sufficient coverage, iii) vary existing or new attributes. Through an elicitation study, we uncovered user needs for diversity in image generation. A pilot validation showed that Varif.ai made achieving diverse image sets easier. In a controlled evaluation with 20 participants, Varif.ai proved more effective than baseline methods across various scenarios. Thus, this supports user control of diversity in image generation for creative ideation and scalable image generation.2025MMMario Michelessa et al.Generative AI (Text, Image, Music, Video)Recommender System UXAI-Assisted Creative WritingDIS
EuterPen: Unleashing Creative Expression in Music Score WritingMusic notation programs force composers to follow the many rules of the staff notation when writing music and constantly seek to optimize symbol placement, making numerous adjustments automatically. Even though this impedes their creative process, many composers still use them throughout their workflow, for lack of a better option. We introduce EuterPen, a music notation program prototype that selectively relaxes both syntactic and structural constraints while editing a score. Composers can input and manipulate music symbols with increased flexibility, leveraging the affordances of pen and touch. They can make space on, between and around staves to insert additional content such as digital ink, pictures and audio samples. We describe the iterative design process that led to EuterPen: prototyping phases, a participatory design workshop, and a series of interviews. Feedback from the participating professional composers indicates that EuterPen offers a compelling and promising approach to music writing.2025VCVincent Cavez et al.Université Paris-Saclay, CNRS, Inria, LISNMusic Composition & Sound Design ToolsGraphic Design & Typography ToolsCreative Collaboration & Feedback SystemsCHI
Human Robot Interaction for Blind and Low Vision People: A Systematic Literature ReviewRecent years have witnessed a growing interest in using robots to support Blind and Low Vision (BLV) people in various tasks and contexts. However, the Human-Computer Interaction (HCI) community still lacks a shared understanding of what, where, and how robots can benefit BLV users in their daily lives. In light of this, we conducted a systematic literature review to help researchers navigate the current landscape of this field through an HCI lens. We followed a systematic multi-stage approach and carefully selected a corpus of 76 papers from premier HCI venues. Our review provides a comprehensive overview of application areas, embodiments, and interaction techniques of the developed robotic systems. Further, we identified opportunities, challenges, and key considerations in this emerging field. Through this systematic review, we aim to inspire researchers, developers, designers, and HCI practitioners, to create a more inclusive environment for the BLV community.2025YWYize Wei et al.National University of Singapore, Department of Computer Science; National University of Singapore, Augmented Human LabVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)Universal & Inclusive DesignSocial Robot InteractionCHI
A Systematic Literature Review to Characterize Asymmetric Interaction in Collaborative SystemsComputer-mediated collaboration often relies on symmetrical interactions between users, where all the collaborators use identical devices. However, in some cases, either due to constraints (e.g. users in different environments) or by choice (e.g. using devices with different properties), users engage in asymmetrical interactions. Addressing such asymmetries in heterogeneous systems can be difficult as there has been no systematic analysis of how to define them, or their impact on collaboration. In this paper, we characterize the asymmetries that can arise between users’ interactions within collaborative heterogeneous systems. To this end, we conduct a systematic literature review of asymmetric collaborative systems, coding their properties, including the interaction spaces, their input and output modalities, and shared feedback. We then define the dimensions of asymmetry that emerge from this review. We discuss their impact on collaboration and outline a set of challenges and opportunities for future research.2025VBVictor Bréhault et al.Université Toulouse 3, IRIT - ELIPSEDistributed Team CollaborationPrototyping & User TestingCHI
Systemic Sustainable HCI: Integrating Collaborative Modeling into a Design Process to Address Rebound EffectsThe introduction of a new product or service into society can have detrimental effects on the environment due to changes in usage and practices. Human-Computer Interaction (HCI) designers need practical methods to address it. In this paper, we explore whether systemic modeling could help designers understand and mitigate these rebound effects. Drawing on systemic design and system dynamics, we prototyped a collaborative modeling methodology that ten professional designers applied to a case study in two workshops. We share insights on their adoption of the methodology and their feedback on its usefulness, usability, and feasibility. Our results indicate that designers find the systemic modeling approach relevant and useful for addressing rebound effects. Influence diagrams can help structure design ideas and identify unaddressed points, while dynamic modeling can help compare design strategies. Based on these findings, we propose a framework for integrating this approach into a design process.2024LBLaetitia Bornes et al.Sustainable HCIEcological Design & Green ComputingDIS
Challenges of Music Score Writing and the Potentials of Interactive SurfacesComposers use music notation programs throughout their creative process. Those programs are essentially elaborate structured document editors that enable composers to create high-quality scores by enforcing musical notation rules. They effectively support music engraving, but impede the more creative stages in the composition process because of their lack of flexibility. Composers thus often combine these desktop tools with other mediums such as paper. Interactive surfaces that support pen and touch input have the potential to address the tension between the contradicting needs for structure and flexibility. We interview nine professional composers. We report insights about their thought process and creative intentions, and rely on the ``Cognitive Dimensions of Notations'' framework to capture the frictions they experience when materializing those intentions on a score. We then discuss how interactive surfaces could increase flexibility by temporarily breaking the structure when manipulating the notation.2024VCVincent Cavez et al.Université Paris-Saclay, CNRS, InriaMusic Composition & Sound Design ToolsCreative Collaboration & Feedback SystemsCHI
Working with Forensic Practitioners to Understand the Opportunities and Challenges for Mixed-Reality Digital AutopsyForensic practitioners analyse intrinsic 3D data daily on 2D screens. We explore novel immersive visualisation techniques that enable digital autopsy through analysis of 3D imagery. We employ a user-centred design process involving four rounds of user feedback: (1) formative interviews eliciting opportunities and requirements for mixed-reality digital autopsies; (2) a larger workshop identifying our prototype's limitations and further use-cases and interaction ideas; (3+4) two rounds of qualitative user validation of successive prototypes of novel interaction techniques for pathologist sensemaking. Overall, we find MR holds great potential to enable digital autopsy, initially to supplement physical autopsy, but ultimately to replace it. We found that experts were able to use our tool to perform basic virtual autopsy tasks, MR setup promotes exploration and sense making of cause of death, and subject to limitations of current MR technology, the proposed system is a valid option for digital autopsies, according to experts' feedback.2023VPVahid Pooryousef et al.Monash UniversityMixed Reality WorkspacesVR Medical Training & RehabilitationMedical & Scientific Data VisualizationCHI
User-Driven Constraints for Layout Optimisation in Augmented RealityAutomatic layout optimisation allows users to arrange augmented reality content in the real-world environment without the need for tedious manual interactions. This optimisation is often based on modelling the intended content placement as constraints, defined as cost functions. Then, applying a cost minimization algorithm leads to a desirable placement. However, such an approach is limited by the lack of user control over the optimisation results. In this paper we explore the concept of user-driven constraints for augmented reality layout optimisation. With our approach users can define and set up their own constraints directly within the real-world environment. We first present a design space composed of three dimensions: the constraints, the regions of interest and the constraint parameters. Then we explore which input gestures can be employed to define the user-driven constraints of our design space through a user elicitation study. Using the results of the study, we propose a holistic system design and implementation demonstrating our user-driven constraints, which we evaluate in a final user study where participants had to create several constraints at the same time to arrange a set of virtual contents.2023ANAziz Niyazov et al.IRIT - University of ToulouseAR Navigation & Context AwarenessMixed Reality WorkspacesPrototyping & User TestingCHI
Tactilient: Turbulence resilient tactile icons for pilot feedbackGiven the high attentional demand in aircraft cockpits, tactons can be used to deliver information without overloading the visual and auditory channels. However, aircraft are subject to turbulence that interfere with vibrotactile feedback. To investigate the impact of turbulence on tacton identification, 18 participants tried to identify 9 tactons with varying intensity and rhythm, while experiencing uncomfortable and very uncomfortable levels of mechanical vibration defined in ISO 2631-1. The results show that the effectiveness of tactile communication decreases with the rhythm identification performance as the level of turbulence increases. In our study, an RMS acceleration delta of 0.70~Grms between two consecutive tactons guaranteed near zero confusion. Based on their experience performing the study, participants built tactons that included 4 pulses, lasted for at least 350~ms and vibrated at no less than 1.25~Grms to be comfortably perceived. Our results will support practitioners for designing tactons that can be more resilient to turbulence.2023DVJonas Vogelsang et al.ENAC – Université de ToulouseIn-Vehicle Haptic, Audio & Multimodal FeedbackVibrotactile Feedback & Skin StimulationCHI
Tactile Fixations: A Behavioral Marker on How People with Visual Impairments Explore Raised-line GraphicsRaised-line graphics are tactile documents made for people with visual impairments (VI). Their exploration relies on a complex two-handed behavior. To better understand the cognitive processes underlying this exploration, we proposed a new method based on “tactile fixations”. A tactile fixation occurs when a finger is stationary within a specific spatial and temporal window. It is known that stationary fingers play an active role when exploring tactile graphics, but they have never been defined or studied before. In this study, we first defined the concept of tactile fixation, then we conducted a behavioral study with ten participants with VI in order to assess the role of tactile fixations under different conditions. The results show that tactile fixations vary according to different factors such as the graphic type as well as the involved hand and the aim of the exploration.2021KZKaixing Zhao et al.University of ToulouseVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)CHI
Review of Quantitative Empirical Evaluations of Technology for People with Visual ImpairmentsAddressing the needs of visually impaired people is of continued interest in Human Computer Interaction (HCI) research. Yet, one of the major challenges facing researchers in this field continues to be how to design adequate quantitative empirical evaluation for these users in HCI. In this paper, we analyse a corpus of 178 papers on technologies designed for people with visual impairments, published since 1988, and including at least one quantitative empirical evaluation (243 evaluations in total). To inform future research in this area, we provide an overview, historic trends and a unified terminology to design and report quantitative empirical evaluations. We identify open issues and propose a set of guidelines to address them. Our analysis aims to facilitate and stimulate future research on this topic.2020EBEmeline Brulé et al.University of SussexVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)User Research Methods (Interviews, Surveys, Observation)Prototyping & User TestingCHI
Robots for Inclusive Play: Co-designing an Educational Game With Visually Impaired and sighted ChildrenDespite being included in mainstream schools, visually impaired children still face barriers to social engagement and participation. Games could potentially help, but games that cater for both visually impaired and sighted players are scarce. We used a co-design approach to design and evaluate a robot-based educational game that could be inclusive of both visually impaired and sighted children in the context of mainstream education. We ran a focus group discussion with visual impairment educators to understand barriers to inclusive play. And then a series of co-design workshops to engage visually impaired and sighted children and educators in learning about robot technology and exploring its potential to support inclusive play experiences. We present design guidelines and an evaluation workshop of a game prototype, demonstrating group dynamics conducive to collaborative learning experiences, including shared goal setting/execution, closely coupled division of labour, and interaction symmetry.2020OMOussama Metatla et al.University of BristolAccessible GamingSerious & Functional GamesSpecial Education TechnologyCHI
Multi-plié: A Linear Foldable and Flattenable Interactive Display to Support Efficiency, Safety and CollaborationWe present the design concept of an accordion-fold interactive display to address the limits of touch-based interaction in airliner cockpits. Based on an analysis of pilot activity, tangible design principles for this design concept are identified. Two resulting functional prototypes are explored during participatory workshops with pilots, using activity scenarios. This exploration validated the design concept by revealing its ability to match pilot responsibilities in terms of safety, efficiency and collaboration. It provides an efficient visual perception of the system for real-time collaborative operations and tangible interaction to strengthen the perception of action and to manage safety through anticipation and awareness. The design work and insights enabled to specify further our needs regarding flexible screens. They also helped to better characterize the design concept as based on continuity of a developed surface, predictability of aligned folds and pleat face roles, embodied interactive properties, and flexibility through affordable reconfigurations.2019SPSylvain Pauchet et al.University of Toulouse - ENAC & AstrolabShape-Changing Interfaces & Soft Robotic MaterialsKnowledge Worker Tools & WorkflowsCHI
Finding Information on Non-Rectangular InterfacesWith upcoming breakthroughs in free-form display technologies, new user interface design challenges have emerged. Here, we investigate a question, which has been widely explored on traditional GUIs but unexplored on non-rectangular interfaces: what are the user strategies in terms of visual search when information is not presented in a traditional rectangular layout? To achieve this, we present two complementary studies investigating eye movements in different visual search tasks. Our results unveil which areas are seen first according to different visual structures. By doing so we address the question of where to place relevant content for the UI designers of non-rectangular displays.2019FSFlorine Simon et al.University of ToulouseVisualization Perception & CognitionPrototyping & User TestingCHI
Inclusive Education Technologies: Emerging Opportunities for People with Visual ImpairmentsTechnology has become central to many activities of learning, ranging from its use in classroom education to work training, mastering a new hobby, or acquiring new skills of living. While digitally-enhanced learning tools can provide valuable access to information and personalised support, people with specific accessibility needs, such as low or no vision, can often be excluded from their use. This requires technology developers to build more inclusive designs and to offer learning experiences that can be shared by people with mixed-visual abilities. There is also scope to integrate DIY approaches and provide specialised teachers with the ability to design their own low cost educational tools, adapted to pedagogical objectives and to the variety of visual and cognitive abilities of their students. For researchers, this invites new challenges of how to best support technology adoption and its evaluation in often complex educational settings. This workshop seeks to bring together researchers and practitioners interested in accessibility and education to share best practices and lessons learnt for technology in this space; and to jointly discuss and develop future directions for the next generation design of inclusive and effective education technologies.2018OMOussama Metatla et al.University of BristolCognitive Impairment & Neurodiversity (Autism, ADHD, Dyslexia)Aging-Friendly Technology DesignUniversal & Inclusive DesignCHI
Rolling-Menu: Rapid Command Selection in Toolbars Using Roll Gestures with a Multi-DoF MouseThis paper presents Rolling-Menu, a technique for selecting toolbar items, based on the use of roll gestures with a multidimensional device, the Roly-Poly Mouse (RPM). Rolling-Menu reduces object-command transition, resulting in a better integration between command selection and direct manipulation of application objects. Selecting a toolbar item with Rolling-Menu requires rolling RPM in a predefined direction corresponding to the item. We propose a design space of Rolling-Menu that includes different roll mapping and validation modes. A first user's study, with a simple toolbar containing up to 14 items, establishes that the best version of Rolling-Menu takes, on average, up to 29% less time than the Mouse to select a toolbar item. Moreover accuracy of the selection with Rolling-Menu is above 90%. Both the validation mode and the mapping between roll direction and toolbar items influence the performance of Rolling-Menus. A second study compares the three best versions of Rolling-Menu with the Mouse to select an item in two types of multidimensional toolbars: a toolbar containing dropdown lists, and a grid toolbar. Results confirm the advantage of Rolling-Menu over a Mouse.2018EDEmmanuel Dubois et al.IRITFull-Body Interaction & Embodied InputKnowledge Worker Tools & WorkflowsPrototyping & User TestingCHI
Interacting with Autonomous Vehicles: Learning from other DomainsThe rise of evermore autonomy in vehicles and the expected introduction of self-driving cars have led to a focus on human interactions with such systems from an HCI perspective over the last years. Automotive User Interface researchers have been investigating issues such as transition control procedures, shared control, (over)trust, and overall user experience in automated vehicles. Now, it is time to open the research field of automated driving to other CHI research fields, such as Human-Robot-Interaction (HRI), aeronautics and space, conversational agents, or smart devices. These communities have been dealing with the interplay between humans and automated systems for more than 30 years. In this workshop, we aim to provide a forum to discuss what can be learnt from other domains for the design of autonomous vehicles. Interaction design problems that occur in these domains, such as transition control procedures, how to build trust in the system, and ethics will be discussed.2018AMAlexander Meschtscherjakov et al.University of SalzburgAutomated Driving Interface & Takeover DesignAI Ethics, Fairness & AccountabilityHuman-Robot Collaboration (HRC)CHI