Driving with Algorithms Beyond Gig Work: Investigating How Algorithmic Management Affects Workers’ Practices in On-Demand Ride-Pooling ServiceOn-demand ride-pooling (ODRP) services are a new alternative modes of transportation that have recently emerged due to technological advancements. While algorithmic management plays a crucial role in ODRP services and can create complex workplace dynamics, the experiences of ODRP workers remain underexplored in the HCI field. To address this gap, we interviewed 16 drivers of Shucle, an ODRP service in South Korea. We examined the drivers' detailed work practices, focusing on the perceived challenges of working under algorithmic management and the perceived benefits and necessity of algorithmic management. This paper provides empirical evidence of the impact of algorithmic management on ODRP drivers' work environments and discusses the implications of our findings for supporting algorithmic workplaces in ODRP services. By positioning ODRP drivers as company employees embedded within a vast, dynamic traffic environment, our study extends algorithmic management scholarship beyond gig work and other algorithmic work contexts, offering fresh insights into how autonomy and accountability are configured across algorithmic workplaces.2025YSYongjae Sohn et al.Immersion & Presence ResearchImpact of Automation on WorkRidesharing PlatformsDIS
“What If Smart Homes Could See Our Homes?”: Exploring DIY Smart Home Building Experiences with VLM-Based Camera SensorsThe advancement of Vision-Language Model (VLM) camera sensors, which enable autonomous understanding of household situations without user intervention, has the potential to completely transform the DIY smart home building experience. Will this simplify or complicate the DIY smart home process? Additionally, what features do users want to create using these sensors? To explore this, we conducted a three-week diary-based experience prototyping study with 12 participants. Participants recorded their daily activities, used GPT to analyze the images, and manually customized and tested smart home features based on the analysis. The study revealed three key findings: (1) participants’ expectations for VLM camera-based smart homes, (2) the impact of VLM camera sensor characteristics on the DIY process, and (3) users’ concerns. Through the findings of this study, we propose design implications to support the DIY smart home building process with VLM camera sensors, and discuss living with intelligence.2025SYSojeong Yun et al.KAIST, Department of Industrial DesignContext-Aware ComputingUbiquitous ComputingSmart Home Interaction DesignCHI
User Experience of LLM-based Recommendation Systems: A Case of Music RecommendationThe advancement of large language models (LLMs) now allows users to actively interact with conversational recommendation systems (CRS) and build their own personalized recommendation services tailored to their unique needs and goals. This experience offers users a significantly higher level of controllability compared to traditional RS, enabling an entirely new dimension of recommendation experiences. Building on this context, this study explored the unique experiences that LLM-powered CRS can provide compared to traditional RS. Through a three-week diary study with 12 participants using custom GPTs for music recommendations, we found that LLM-powered CRS can (1) help users clarify implicit needs, (2) support unique exploration, and (3) facilitate a deeper understanding of musical preferences. Based on these findings, we discuss the new design space enabled by LLM-powered CRS and highlight its potential to support more personalized, user-driven recommendation experiences.2025SYSojeong Yun et al.KAIST, Department of Industrial DesignHuman-LLM CollaborationRecommender System UXCHI
Why I Choose This Sticker When Chatting with You: Exploring Design Considerations for Sticker Recommendation Services in Mobile Instant MessengersNowadays, many mobile instant messenger (MIM) users employ stickers to express their emotions. Due to the increase in the variety of stickers, many MIM platforms have begun to offer sticker recommendation services, which suggest appropriate stickers based on the context of conversations. Although sticker recommendation services need to consider users’ subtle social and psychological needs from the perspective that stickers are an alternative communication language, few attempts have been made to explore this area. Consequently, we investigated sticker usage practices through a qualitative study with 18 KakaoTalk users in South Korea. Based on the results of this study, we revealed user's three common considerations in sticker usage experiences and discussed the design implications for sticker recommendation services in MIM.2024GBGahyeon Bae et al.Session 2f: UX, Visual Communication and DesignCSCW
How We Use Together: Coordinating Individual Preferences for Using Shared Devices at HomeSmart home devices increasingly aim to offer personalized experiences based on individual usage patterns and preferences. However, individuals in multi-person households often find themselves navigating daily life by coordinating with other members. This article aims to understand how users align their preferences for shared technology and their expectations for future smart homes in such contexts. To this end, we conducted a 7-day diary study and in-depth interviews to observe how members of multi-person households coordinate their preferences in everyday life. We discovered that members' device usage is not solely influenced by their own preferences, but is significantly affected by the preferences and social contexts of other members. We identified three strategies for coordinating preferences: coordination according to shared priorities, coordination according to shared rules, and coordination for relationships. Participants expected future smart homes to support their coordination needs. We propose design implications for multi-user smart homes that support coordination.2024YLYoomi Lee et al.Smart Home Interaction DesignWarehouse & Industrial RobotsParticipatory DesignDIS
Investigating the Potential of Group Recommendation Systems As a Medium of Social Interactions: A Case of Spotify Blend Experiences between Two UsersDesigning user experiences for group recommendation systems (GRS) is challenging, requiring a nuanced understanding of the influence of social interactions between users. Using Spotify Blend as a real-world case of music GRS, we conducted empirical studies to investigate intricate social interactions among South Korean users in GRS. Through a preliminary survey about Blend experiences in general, we narrowed the focus for the main study to relationships between two users who are acquainted or close. Building on this, we conducted a 21-day diary study and interviews with 30 participants (15 pairs) to probe more in-depth interpersonal dynamics within Blend. Our findings reveal that users engaged in implicit social interactions, including tacit understanding of their companions and indirect communication. We conclude by discussing the newly discovered value of GRS as a social catalyst, along with design attributes and challenges for the social experiences it mediates.2024DKDaehyun Kwak et al.KAISTRecommender System UXCHI
Investigating How Users Design Everyday Intelligent Systems in UseIntelligent systems learn and evolve depending on what kinds of input are given and how people actually use them after deployment. While such a characteristic may be a troubling property for AI user experience designers, it also imbues an intelligent system with an open-ended quality, empowering end-users to ‘design’ their own system in use to achieve more desired experiences. In light of this, we conducted in-depth interviews with 16 users of various AI-based everyday recommender systems, investigating how people design their AI user experiences in actual use contexts. Exploring people’s current experiences of adopting and adapting those systems to achieve their own desired experiences, we discovered three styles of end-user design of their experiences: teaching, resisting, and repurposing. We end with a discussion of the implications of our findings, recognizing end-users’ motivation to challenge a prescribed experience of an intelligent system.2023HKJuho Kim et al.Generative AI (Text, Image, Music, Video)AI-Assisted Decision-Making & AutomationRecommender System UXDIS
Balancing Flexibility and Authority: Exploring Negotiation as an Interaction Strategy for Healthy Sleep BehaviorsSleep hygiene is a recommendation to help improve sleep quality; many persuasive technologies have been designed in human–computer interaction (HCI) studies to support sleep hygiene routines. However, a critical challenge is that users intentionally do not follow the recommendations because these often conflict with the user’s preferences or circumstances. To overcome this problem, we propose an alternative interaction strategy by which users can negotiate their sleep hygiene activities. Instead of emphasizing idealized rules for users, goals mutually agreed between the user and the system may support adherence to sleep hygiene. To explore the potential and experience of negotiating sleep hygiene goals, users and design researchers engaged in improvisational role-playing to simulate negotiations. We found that negotiation could support positive attitudes and self-efficacy in adhering to sleep hygiene practices. We discuss the balance between flexibility and authority as the primary characteristics of negotiation, and how to design negotiation-based interactive systems.2023SSSunmin Son et al.Mental Health Apps & Online Support CommunitiesSleep & Stress MonitoringDIS
Potential and Challenges of DIY Smart Homes with an ML-intensive Camera SensorSensors and actuators are crucial components of a do-it-yourself (DIY) smart home system that enables users to construct smart home features successfully. In addition, machine learning (ML) (e.g., ML-intensive camera sensors) can be applied to sensor technology to increase its accuracy. Although camera sensors are often utilized in homes, research on user experiences with DIY smart home systems employing camera sensors is still in its infancy. This research investigates novel user experiences while constructing DIY smart home features using an ML-intensive camera sensor in contrast to commonly used internet-of-things (IoT) sensors. Thus, we conducted a seven-day field diary study with 12 families who were given a DIY smart home kit. Here, we assess the five characteristics of the camera sensor as well as the potential and challenges of utilizing the camera sensor in the DIY smart home and discuss the opportunities to address existing DIY smart home issues.2023SYSojeong Yun et al.KAISTIoT Device PrivacySmart Home Interaction DesignCHI
Social-Spiritual Face: Designing Social Reading Support for Spiritual Well-beingTechno-spiritual practices refer to the use of digital technologies to support various spiritual activities, such as scripture reading. While prior human-computer interaction studies largely focus on understanding techno-spiritual practices in both personal and ministry environments, there is a lack of design research that explores novel design opportunities, based on longitudinal field deployment. As an important techno-spiritual practice, this work focuses on scripture reading and investigates the design space of "social scripture reading," as it is often organized into small groups for successful behavior maintenance. We designed and evaluated BibleCell, a social scripture reading tool that supports personalized reading plans, scripture reading, and social sharing. After the third year of deployment, we performed a two-month user study in Korean Protestant churches to deepen our understanding of techno-spiritual practices in social contexts via in-depth interviews (n = 27). We report the major themes of social techno-spiritual practices, such as social motivators, social interaction patterns, and leadership roles. We discuss our findings using a novel design concept of social-spiritual awareness that considers both the social and spiritual aspects of interactions in social computing systems.2022IKInyeop Kim et al.Mental Health and Spirituality Tools; Mental Health and Spirituality ToolsCSCW
Teaching-Learning Interaction: A New Concept for Interaction Design to Support Reflective User Agency in Intelligent SystemsIntelligent systems in everyday lives learn about their users to tailor services over time. However, these systems are often designed with little consideration of user agency on their learning processes, hindering users from taking full advantage of the systems. In this paper, we propose Teaching-Learning Interaction (TLI) as a new form of interaction that affords user agency by letting users reflectively shepherd an intelligent system’s manner of learning. Given such agency, users will be able to better personalize services for themselves. We first draw on Schön’s notion of knowing-in-action and reflective practice to theoretically ground our concept. We then present the resulting definition of TLI and three design qualities, which are further concretized with three design examples. We end with discussion on the implications of TLI for HCI design.2021HKHankyung Kim et al.Human-LLM CollaborationAI-Assisted Decision-Making & AutomationUser Research Methods (Interviews, Surveys, Observation)DIS
Guiding Preferred Driving Style Using Voice in Autonomous Vehicles: An On-Road Wizard-of-Oz StudyMatching the autonomous vehicle’s (AV) driving style to its user’s preference is core to a satisfactory user experience. The recent HCI community has undertaken a significant amount of research to understand user-preferred driving styles in AVs. Due to its multifaceted nature, understanding these driving preferences is difficult unless users take roles in an adaptive system and share their needs explicitly. However, there is a lack of a proper channel for users to express their driving-style needs in AVs. To bridge this gap, we suggest a 'user’s preferred driving-style guidance using voice' as a novel input channel for human-centric AV control. We conducted a Wizard-of-Oz driving study on real roads, aiming to explore the guiding experience with the AV agent to reflect their driving-style preferences. This paper presents the value of driving-style guidance along with its burden to users, and concludes with its implications in designing a better AV-guiding experience.2021KKJuho Kim et al.Automated Driving Interface & Takeover DesignIntelligent Voice Assistants (Alexa, Siri, etc.)DIS
Understanding How Users Experience the Physiological Expression of Non-humanoid Voice-based Conversational Agent in Healthcare ServicesInteractions with voice-based conversational agents (VCAs) in non-humanoid forms are becoming increasingly pervasive, and researches on non-humanoid VCAs engaging diverse human traits have been conducted. However, there have never been studies employing living body’s physiological states to be expressed solely through the voice of such VCAs yet. As physiological expressions of such VCAs can have potential for manifesting health-related issues in a human-like way, we selected healthcare scenarios as a case for exploring novel user experiences that they can induce. We conducted design workshops for identifying design considerations and design opportunities for the physiologically expressible VCAs in the healthcare service domain. Following these findings, we designed the new concept of physiologically expressible healthcare VCAs and conducted a Wizard-of-Oz user study. Finally, we summarize the unique user experiences on physiologically expressible VCA’s healthcare services and user perceptions of its physiological expressions, and discuss design implications for physiologically expressible VCAs.2021IJInchan Jung et al.Voice User Interface (VUI) DesignVoice AccessibilityDIS
Exploring the Use of a Voice-based Conversational Agent to Empower Adolescents with Autism Spectrum DisorderVoice-based Conversational Agents (VCA) have served as personal assistants that support individuals with special needs. Adolescents with Autism Spectrum Disorder (ASD) may also benefit from VCAs to deal with their everyday needs and challenges, ranging from self-care to social communications. In this study, we explored how VCAs could encourage adolescents with ASD in navigating various aspects of their daily lives through the two-week use of VCAs and a series of participatory design workshops. Our findings demonstrated that VCAs could be an engaging, empowering, emancipating tool that supports adolescents with ASD to address their needs, personalities, and expectations, such as promoting self-care skills, regulating negative emotions, and practicing conversational skills. We propose implications of using off-the-shelf technologies as a personal assistant to ASD users in Assistive Technology design. We suggest design implications for promoting positive opportunities while mitigating the remaining challenges of VCAs for adolescents with ASD.2021ICInha Cha et al.KAISTConversational ChatbotsCognitive Impairment & Neurodiversity (Autism, ADHD, Dyslexia)Augmentative & Alternative Communication (AAC)CHI
MirrorPad: Mirror on Touchpad for Direct Pen Interaction in the Laptop EnvironmentThere are needs for pen interaction on a laptop, and the market sees many pen-enabled laptop products. Many of these laptops can be transformed into tablets, when pen interaction is needed. In a real situation, however, a workflow often requires both keyboard and pen interactions, and such a convertible feature may not be effective. In this study, we introduce MirrorPad, a novel interface device contained in a laptop for direct pen interaction. It is both a normal touchpad and a viewport for pen interaction with a mirrored region on the screen. We report findings and decisions obtained from the design iterations that we conducted with users to refine MirrorPad toward the final design. In the user study, MirrorPad showed the same performance as that of the laptop configuration during keyboard interaction and a performance similar to that of the tablet configuration during pen interaction. The user study results confirmed that MirrorPad effectively supports a workflow, which requires interspersed keyboard and pen interactions, thereby achieving its initial goal.2020SLSangyoon Lee et al.Korea Advanced Institute of Science and Technology360° Video & Panoramic ContentPrototyping & User TestingCHI
Investigating User Expectations on the Roles of Family-shared AI SpeakersAI assistants that use a voice user interface (VUI), such as AI speakers, have become popular in family homes. However, it is still unclear what roles the AI speaker can support within the family unit. We investigated the roles of an AI speaker as a family-shared technology. By conducting a one-week participatory user study, we discovered that family members' co-ownership toward the AI speaker was the key in the development of its family-oriented roles. Our findings showed seven domains of user expectations on these roles, and we realized that all the expectations can be represented as family cohesion. In addition, privacy awareness was emphasized regarding personal supports. Finally, we discuss a new perspective for AI speaker design and offer two suggestions: 1) leveraging human-likeness to develop its potential roles of supporting the unit of a family and 2) interpreting the home context to seamlessly connect family and personal supporting roles.2020SPSunjeong Park et al.Korea Advanced Institute of Science and TechnologyAgent Personality & AnthropomorphismPrivacy by Design & User ControlHome Voice Assistant ExperienceCHI
Co-Performing Agent: Design for Building User-Agent Partnership in Learning and Adaptive ServicesIntelligent agents have become prevalent in everyday IT products and services. To improve an agent's knowledge of a user and the quality of personalized service experience, it is important for the agent to cooperate with the user (e.g., asking users to provide their information and feedback). However, few works inform how to support such user-agent co-performance from a human-centered perspective. To fill this gap, we devised Co-Performing Agent, a Wizard-of-Oz-based research probe of an agent that cooperates with a user to learn by helping users to have a partnership mindset. By incorporating the probe, we conducted a two-month exploratory study, aiming to understand how users experience co-performing with their agent over time. Based on the findings, this paper presents the factors that affected users' co-performing behaviors and discusses design implications for supporting constructive co-performance and building a resilient user–agent partnership over time.2019DKDa-jung Kim et al.Korea Advanced Institute of Science and TechnologyAgent Personality & AnthropomorphismHuman-LLM CollaborationCHI
Ten-Minute Silence: A New Notification UX of Mobile Instant MessengerPeople receive a tremendous number of messages through mobile instant messaging (MIM), which generates crowded notifications. This study highlights our attempt to create a new notification rule to reduce this crowdedness, which can be recognized by both senders and recipients. We developed an MIM app that provides only one notification per conversation session, which is a group of consecutive messages distinguished based on a ten-minute silence period. Through the two-week field study, 20,957 message logs and interview data from 17 participants revealed that MIM notifications affect not only the recipients' experiences before opening the app but also the entire conversation experience, including that of the senders. The new notification rule created new social norms for the participants' use of MIM. We report themes about the changes in the MIM experience, which will expand the role of notifications for future MIM apps.2019ISIn-geon Shin et al.Korea Advanced Institute of Science and TechnologyNotification & Interruption ManagementCHI
Too Close and Crowded: Understanding Stress on Mobile Instant Messengers based on ProxemicsNowadays, mobile instant messaging (MIM) is a necessity for our private and public lives, but it has also been the cause of stress. In South Korea, MIM stress has become a serious social problem. To understand this stress, we conducted four focus groups with 20 participants under MIM stress. We initially discovered that MIM stress relates to how people perceive the territory in MIM. We then applied proxemics—the theory of human use of space—to the thematic analysis as the rationale. The data revealed two main themes: too close and too crowded. The participants were stressed due to design features that let strangers or crowds into their MIM applications and forced them to interact and share their status with them. Based on this finding, we propose a set of implications for designing anti-stress MIM applications.2018ISIn-geon Shin et al.KAISTSocial Platform Design & User BehaviorNotification & Interruption ManagementCHI