All

Papers

Browse and search HCI research papers from All

Active Filters

Institution: HKUST

320 results

Eye2Recall: Exploring Mixed-Initiative Reminiscence Activities via Gaze-Driven LLM Prompts for Older Adults

Photo-based reminiscence can support well-being in older adults, yet most systems remain text-driven and offer little real-time adaptivity. We first conduct expert interviews to derive design considerations for accessibility, cultural fit, and safe emotional engagement. We then implemented Eye2Recall, an intelligent…

Lei Han et al.Hong Kong University of Science and Technology

Adaptive Prompt Elicitation for Text-to-Image Generation

Aligning text-to-image generation with user intent remains challenging, as users frequently provide ambiguous inputs and struggle with model idiosyncrasies. We propose Adaptive Prompt Elicitation (APE), a technique that adaptively poses visual queries to help users refine prompts without extensive writing. Our technic…

Xinyi Wen et al.Aalto University

ESR-Coach: Leveraging Large Language Models for Training People to Provide Emotionally Supportive Responses

Effectively providing emotional support is a critical yet intricate interpersonal skill. Supporters often lack accessible and practical training opportunities to develop this competency. To address this gap, we introduce ESR-Coach, a Large Language Model (LLM)-based coaching system designed to train individuals in emo…

Gongyao Jiang et al.Hong Kong University of Science and Technology

ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactions

From purchasing a gift to deciding on a hobby, unfamiliar decisions---decisions without domain knowledge and experience---are frequent and significant. The complexity and uncertainty of such decisions demand unique approaches to information seeking, understanding, and decision-making. Our formative study highlights th…

Jeongeon Park et al.University of California - San Diego

AdRecommended

Learn AI Coding at CodeNow

Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work.

Explore Now

DuoDrama: Supporting Screenplay Refinement Through LLM-Assisted Human Reflection

AI has been increasingly integrated into screenwriting practice. In refinement, screenwriters expect AI to provide feedback that supports reflection across the internal perspective of characters and the external perspective of the overall story. However, existing AI tools cannot sufficiently coordinate the two perspec…

Yuying Tang et al.Hong Kong University of Science and Technology

Agency-Enhanced Visual Search in VR: Robust to Distraction, Delay, and Perspective Shifts

The sense of agency, the internal feeling of controlling one's actions and their outcomes, fundamentally shapes user interaction in virtual environments. Although extensively studied for its subjective impact, agency’s implicit yet critical role in guiding visual-spatial attention has been largely overlooked. This stu…

Chunlin Liao et al.Beijing Normal University - Hong Kong Baptist University

Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight

The dark patterns, deceptive interface designs manipulating user behaviors, have been extensively studied for their effects on human decision-making and autonomy. Yet, with the rising prominence of LLM-powered GUI agents that automate tasks from high-level intents, understanding how dark patterns affect agents is incr…

Jingyu Tang et al.Huazhong University of Science and Technology

Hidden Labor behind the Hype: Understanding AI Side Hustles through Platform Narratives and Worker Practices

AI side hustles are increasingly promoted on social media as accessible, empowering, and profitable opportunities. This paper examines the gap between such platform narratives and workers' lived experiences through a mixed-method study of 7,938 RedNote posts and 16 semi-structured interviews. Our analysis identifies m…

Xiaoyu YANG et al.Hong Kong University of Science and Technology

Who Gets Written In? Gender, Identity, and Moderation in AO3’s Celebrity Fanfiction

Archive of Our Own (AO3) is a prominent fanfiction platform widely recognized for its feminist design ethos, with a commitment to inclusive, pluralism and community-driven content creation. Among the content on it, Real Person Fiction (RPF) --- creations based on public figures rather than fictional characters --- of…

Peixian Zhang et al.

The Hong Kong University of Science and Technology (Guangzhou)

From Memory to Meaning: A Systematic Review of Reminiscence Technologies in HCI

Technologies designed to support reminiscence, defined as the practice of engaging with one’s personal past, have become a significant area of inquiry within HCI. Although this has generated a diverse range of creative systems, the field still lacks a systematic account of the design principles that guide them. In thi…

Zhongyue Zhang et al.Hong Kong University of Science and Technology

How Do We Evaluate Experiences in Immersive Environments?

How do we evaluate experiences in immersive environments? Despite decades of research in immersive technologies such as virtual reality, the field remains fragmented. Studies rely on overlapping constructs, heterogeneous instruments, and little agreement on what counts as immersive experience. To better understand thi…

Xiang Li et al.University of Cambridge

The Last Door You Open: A Mixed-Methods Study on Design Strategies for Positive Disengagement in Virtual Reality Games

Disengagement plays an important role in the overall game experience. However, extensive game research has focused on creating engaging experiences, whereas how players disengage remains insufficiently understood. Emerging studies have outlined characteristics of disengagement in screen-based video games. Little is kn…

Ziyan Wang et al.Hong Kong University of Science and Technology

RealTwin: Concept Graph Representation and Grounding Framework for Reality-Preserving Digital Twin Reconstruction

Reconstructing realistic digital twins has become crucial as advances in mixed reality, metaverse, and robotics demand more accurate simulations for the physical world. Despite technical progress, building high-fidelity digital twins from a systematic and human-centered perspective remains underexplored. Drawing from…

Zisu Li et al.Hong Kong University of Science and Technology

Orchid-Creator: An Authoring Tool Supporting LLM-Driven Interactive Narrative Creation

Large language models (LLMs) are reshaping interactive digital narratives (IDNs). However, creating complex interactive narratives while preserving narrative consistency remains challenging. We present Orchid‑Creator (Orchid), an LLM-based authoring tool that represents IDNs as story graphs with a card‑based interface…

Zhen Wu et al.Hong Kong University of Science and Technology

DiLLS: Interactive Diagnosis of LLM-based Multi-agent Systems via Layered Summary of Agent Behaviors

Large language model (LLM)-based multi-agent systems have demonstrated impressive capabilities in handling complex tasks. However, the complexity of agentic behaviors makes these systems difficult to understand. When failures occur, developers often struggle to identify root causes and to determine actionable paths fo…

Rui Sheng et al.Hong Kong University of Science and Technology

Reimagining Legal Fact Verification with GenAI: Toward Effective Human-AI Collaboration

Fact verification is a critical yet underexplored component of non-litigation legal practice. While existing research has examined automation in legal workflow and human-AI collaboration in high-stakes domains, little is known about how GenAI can support fact verification, a task that demands prudent judgment and stri…

Sirui Han et al.Hong Kong University of Science and Technology

FingerBar: A Mid-Air Touch Bar Interface for Earphones Using Finger-Generated Acoustics

Current touch-based interactions on earphones are limited by hygiene concerns and the small interaction surface. Recent works attempt to bypass these issues with mid-air gesture systems using active acoustic sensing. However, these signals may be audible and pose potential hearing risks. To address this, we propose Fi…

Yankai Zhao et al.Southern University of Science and Technology

Investigating How Physical Surfaces Can Serve as Common-Region Cues for Perceptual Grouping of Virtual Elements in Augmented Reality

Perceptual grouping enables people to organize elements into units according to intrinsic (e.g., proximity) and extrinsic (e.g., common region) principles. However, the role of physical surfaces as extrinsic grouping cues for virtual elements in Augmented Reality (AR) remains unclear. To provide a deeper understanding…

Xuanhui Yang et al.Hong Kong University of Science and Technology

TableTale: Reviving the Narrative Interplay Between Tables and Text in Scientific Papers

Data tables play a central role in scientific papers. However, their meaning is often co-constructed with surrounding text through narrative interplay, making comprehension cognitively demanding for readers. In this work, we explore how interfaces can better support this reading process. We conducted a formative study…

Liangwei Wang et al.Hong Kong University of Science and Technology

Friend, Foe, or Bot? Exploring Intergroup Dynamics in Hybrid Human-Bot Teams

Existing research has examined how artificial teammates influence collaboration within teams, but far less is known about their role in shaping interactions between teams. In particular, it remains unclear how transparent integration of AI teammates influences intergroup biases in competitive contexts. To investigate…

Assem Zhunis et al.Hong Kong University of Science and Technology

Paper Title	Authors	Research Topics	Paper Database	Year
Eye2Recall: Exploring Mixed-Initiative Reminiscence Activities via Gaze-Driven LLM Prompts for Older Adults Photo-based reminiscence can support well-being in older adults, yet most systems remain text-driven and offer little real-time adaptivity. We first conduct expert interviews to derive design considerations for accessibility, cultural fit, and safe emotional engagement. We then implemented Eye2Recall, an intelligent…	LH Lei Han et al.Hong Kong University of Science and Technology
Adaptive Prompt Elicitation for Text-to-Image Generation Aligning text-to-image generation with user intent remains challenging, as users frequently provide ambiguous inputs and struggle with model idiosyncrasies. We propose Adaptive Prompt Elicitation (APE), a technique that adaptively poses visual queries to help users refine prompts without extensive writing. Our technic…	XW Xinyi Wen et al.Aalto University
ESR-Coach: Leveraging Large Language Models for Training People to Provide Emotionally Supportive Responses Effectively providing emotional support is a critical yet intricate interpersonal skill. Supporters often lack accessible and practical training opportunities to develop this competency. To address this gap, we introduce ESR-Coach, a Large Language Model (LLM)-based coaching system designed to train individuals in emo…	GJ Gongyao Jiang et al.Hong Kong University of Science and Technology
ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactions From purchasing a gift to deciding on a hobby, unfamiliar decisions---decisions without domain knowledge and experience---are frequent and significant. The complexity and uncertainty of such decisions demand unique approaches to information seeking, understanding, and decision-making. Our formative study highlights th…	JP Jeongeon Park et al.University of California - San Diego
AdRecommended Learn AI Coding at CodeNow Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work. Explore Now
DuoDrama: Supporting Screenplay Refinement Through LLM-Assisted Human Reflection AI has been increasingly integrated into screenwriting practice. In refinement, screenwriters expect AI to provide feedback that supports reflection across the internal perspective of characters and the external perspective of the overall story. However, existing AI tools cannot sufficiently coordinate the two perspec…	YT Yuying Tang et al.Hong Kong University of Science and Technology
Agency-Enhanced Visual Search in VR: Robust to Distraction, Delay, and Perspective Shifts The sense of agency, the internal feeling of controlling one's actions and their outcomes, fundamentally shapes user interaction in virtual environments. Although extensively studied for its subjective impact, agency’s implicit yet critical role in guiding visual-spatial attention has been largely overlooked. This stu…	CL Chunlin Liao et al.Beijing Normal University - Hong Kong Baptist University
Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight The dark patterns, deceptive interface designs manipulating user behaviors, have been extensively studied for their effects on human decision-making and autonomy. Yet, with the rising prominence of LLM-powered GUI agents that automate tasks from high-level intents, understanding how dark patterns affect agents is incr…	JT Jingyu Tang et al.Huazhong University of Science and Technology
Hidden Labor behind the Hype: Understanding AI Side Hustles through Platform Narratives and Worker Practices AI side hustles are increasingly promoted on social media as accessible, empowering, and profitable opportunities. This paper examines the gap between such platform narratives and workers' lived experiences through a mixed-method study of 7,938 RedNote posts and 16 semi-structured interviews. Our analysis identifies m…	XY Xiaoyu YANG et al.Hong Kong University of Science and Technology
Who Gets Written In? Gender, Identity, and Moderation in AO3’s Celebrity Fanfiction Archive of Our Own (AO3) is a prominent fanfiction platform widely recognized for its feminist design ethos, with a commitment to inclusive, pluralism and community-driven content creation. Among the content on it, Real Person Fiction (RPF) --- creations based on public figures rather than fictional characters --- of…	PZ Peixian Zhang et al.The Hong Kong University of Science and Technology (Guangzhou)
From Memory to Meaning: A Systematic Review of Reminiscence Technologies in HCI Technologies designed to support reminiscence, defined as the practice of engaging with one’s personal past, have become a significant area of inquiry within HCI. Although this has generated a diverse range of creative systems, the field still lacks a systematic account of the design principles that guide them. In thi…	ZZ Zhongyue Zhang et al.Hong Kong University of Science and Technology
How Do We Evaluate Experiences in Immersive Environments? How do we evaluate experiences in immersive environments? Despite decades of research in immersive technologies such as virtual reality, the field remains fragmented. Studies rely on overlapping constructs, heterogeneous instruments, and little agreement on what counts as immersive experience. To better understand thi…	XL Xiang Li et al.University of Cambridge
The Last Door You Open: A Mixed-Methods Study on Design Strategies for Positive Disengagement in Virtual Reality Games Disengagement plays an important role in the overall game experience. However, extensive game research has focused on creating engaging experiences, whereas how players disengage remains insufficiently understood. Emerging studies have outlined characteristics of disengagement in screen-based video games. Little is kn…	ZW Ziyan Wang et al.Hong Kong University of Science and Technology
RealTwin: Concept Graph Representation and Grounding Framework for Reality-Preserving Digital Twin Reconstruction Reconstructing realistic digital twins has become crucial as advances in mixed reality, metaverse, and robotics demand more accurate simulations for the physical world. Despite technical progress, building high-fidelity digital twins from a systematic and human-centered perspective remains underexplored. Drawing from…	ZL Zisu Li et al.Hong Kong University of Science and Technology
Orchid-Creator: An Authoring Tool Supporting LLM-Driven Interactive Narrative Creation Large language models (LLMs) are reshaping interactive digital narratives (IDNs). However, creating complex interactive narratives while preserving narrative consistency remains challenging. We present Orchid‑Creator (Orchid), an LLM-based authoring tool that represents IDNs as story graphs with a card‑based interface…	ZW Zhen Wu et al.Hong Kong University of Science and Technology
DiLLS: Interactive Diagnosis of LLM-based Multi-agent Systems via Layered Summary of Agent Behaviors Large language model (LLM)-based multi-agent systems have demonstrated impressive capabilities in handling complex tasks. However, the complexity of agentic behaviors makes these systems difficult to understand. When failures occur, developers often struggle to identify root causes and to determine actionable paths fo…	RS Rui Sheng et al.Hong Kong University of Science and Technology
Reimagining Legal Fact Verification with GenAI: Toward Effective Human-AI Collaboration Fact verification is a critical yet underexplored component of non-litigation legal practice. While existing research has examined automation in legal workflow and human-AI collaboration in high-stakes domains, little is known about how GenAI can support fact verification, a task that demands prudent judgment and stri…	SH Sirui Han et al.Hong Kong University of Science and Technology
FingerBar: A Mid-Air Touch Bar Interface for Earphones Using Finger-Generated Acoustics Current touch-based interactions on earphones are limited by hygiene concerns and the small interaction surface. Recent works attempt to bypass these issues with mid-air gesture systems using active acoustic sensing. However, these signals may be audible and pose potential hearing risks. To address this, we propose Fi…	YZ Yankai Zhao et al.Southern University of Science and Technology
emoji_events Investigating How Physical Surfaces Can Serve as Common-Region Cues for Perceptual Grouping of Virtual Elements in Augmented Reality Perceptual grouping enables people to organize elements into units according to intrinsic (e.g., proximity) and extrinsic (e.g., common region) principles. However, the role of physical surfaces as extrinsic grouping cues for virtual elements in Augmented Reality (AR) remains unclear. To provide a deeper understanding…	XY Xuanhui Yang et al.Hong Kong University of Science and Technology
TableTale: Reviving the Narrative Interplay Between Tables and Text in Scientific Papers Data tables play a central role in scientific papers. However, their meaning is often co-constructed with surrounding text through narrative interplay, making comprehension cognitively demanding for readers. In this work, we explore how interfaces can better support this reading process. We conducted a formative study…	LW Liangwei Wang et al.Hong Kong University of Science and Technology
emoji_events Friend, Foe, or Bot? Exploring Intergroup Dynamics in Hybrid Human-Bot Teams Existing research has examined how artificial teammates influence collaboration within teams, but far less is known about their role in shaping interactions between teams. In particular, it remains unclear how transparent integration of AI teammates influences intergroup biases in competitive contexts. To investigate…	AZ Assem Zhunis et al.Hong Kong University of Science and Technology