All

Papers

Browse and search HCI research papers from All

Active Filters

Author: 8306

11 results

Texterial: A Text-as-Material Interaction Paradigm for LLM-Mediated Writing

What if text could be sculpted and refined like clay, or cultivated and pruned like a plant? Texterial reimagines text as a material that users can grow, sculpt, and transform. Current generative-AI models enable rich text operations, yet rigid, linear interfaces often mask such capabilities. We explore how the text-a…

Jocelyn J Shen et al.Microsoft

ImaginationVellum: Generative-AI Ideation Canvas with Spatial Prompts, Generative Strokes, and Ideation History

We introduce ImaginationVellum, a multi-modal spatial canvas for early-stage visual ideation and concept sketching with generative AI. The resulting system supports a unique style of human-AI co-creation where the canvas is the prompt. This means that ImaginationVellum employs the entire 2D canvas as an active prompt…

Nicolai Marquardt et al.Microsoft

Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflows

Despite Generative AI (GenAI) systems' potential for enhancing content creation, users often struggle to effectively integrate GenAI into their creative workflows. Core challenges include misalignment of AI-generated content with user intentions (intent elicitation and alignment), user uncertainty around how to best c…

Frederic Gmeiner et al.Carnegie Mellon University

AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Tools

Chat-based prompts respond with verbose linear-sequential texts, making it difficult to explore and refine ambiguous intents, back up and reinterpret, or shift directions in creative AI-assisted design work. AI-Instruments instead embody "prompts" as interface objects via three key principles: (1) Reification of user-…

Nathalie Riche et al.Microsoft

AdRecommended

Learn AI Coding at CodeNow

Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work.

Explore Now

BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AI

Today’s video-conferencing tools support a rich range of professional and social activities, but their generic meeting environments cannot be dynamically adapted to align with distributed collaborators’ needs. To enable end-user customization, we developed BlendScape, a rendering and composition system for video-confe…

Shwetha Rajaram et al.University of Michigan

SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending

There is increased interest in using generative AI to create 3D spaces for virtual reality (VR) applications. However, today’s models produce artificial environments, falling short of supporting collaborative tasks that benefit from incorporating the user's physical context. To generate environments that support VR te…

Nels Numan et al.Parkview Health

Exploring the Design Space of Input Modalities for Working in Mixed Reality on Long-haul Flights

Flexible working, including in resource-constrained settings such as long-haul flights, poses considerable challenges. While research in mixed reality (MR) offers the potential for enhancing experiences of working on airplanes (WoA), what input modalities and interactions might be suitable for such workspaces is under…

Wen Mo et al.University College London

SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote Collaboration

Collaborating around physical objects necessitates examining different aspects of design or hardware in detail when reviewing or inspecting physical artifacts or prototypes. When collaborators are remote, coordinating the sharing of views of their physical environment becomes challenging. Video-conferencing tools ofte…

Mose Sakashita et al.Cornell University

Pixelated Interactions: Exploring Pixel Art for Graphical Primitives on a Tactile Display

Two-dimensional pin array displays enable access to tactile graphics that are important for the education of students with visual impairments. Due to their prohibitive cost and limited access, there is limited research within HCI and the rules to design graphics on these low-resolution tactile displays are unclear. In…

Tigmanshu Bhatnagar et al.University College London

Style Blink: Exploring Digital Inking of Structured Information via Handcrafted Styling as a First-Class Object

Structured note-taking forms such as sketchnoting, self-tracking journals, and bullet journaling go beyond immediate capture of information scraps. Instead, hand-drawn pride-in-craftmanship increases perceived value for sharing and display. But hand-crafting lists, tables, and calendars is tedious and repetitive. To s…

Hugo Romat et al.CNRS

AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware Armatures

AirConstellations supports a unique semi-fixed style of cross-device interactions via multiple self-spatially-aware armatures to which users can easily attach (or detach) tablets and other devices. In particular, AirConstellations affords highly flexible and dynamic device formations where the users can bring multiple…

Nicolai Marquardt et al.Microsoft

Paper Title	Authors	Research Topics	Paper Database	Year
emoji_events Texterial: A Text-as-Material Interaction Paradigm for LLM-Mediated Writing What if text could be sculpted and refined like clay, or cultivated and pruned like a plant? Texterial reimagines text as a material that users can grow, sculpt, and transform. Current generative-AI models enable rich text operations, yet rigid, linear interfaces often mask such capabilities. We explore how the text-a…	JS Jocelyn J Shen et al.Microsoft
emoji_events ImaginationVellum: Generative-AI Ideation Canvas with Spatial Prompts, Generative Strokes, and Ideation History We introduce ImaginationVellum, a multi-modal spatial canvas for early-stage visual ideation and concept sketching with generative AI. The resulting system supports a unique style of human-AI co-creation where the canvas is the prompt. This means that ImaginationVellum employs the entire 2D canvas as an active prompt…	NM Nicolai Marquardt et al.Microsoft
Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflows Despite Generative AI (GenAI) systems' potential for enhancing content creation, users often struggle to effectively integrate GenAI into their creative workflows. Core challenges include misalignment of AI-generated content with user intentions (intent elicitation and alignment), user uncertainty around how to best c…	FG Frederic Gmeiner et al.Carnegie Mellon University
emoji_events AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Tools Chat-based prompts respond with verbose linear-sequential texts, making it difficult to explore and refine ambiguous intents, back up and reinterpret, or shift directions in creative AI-assisted design work. AI-Instruments instead embody "prompts" as interface objects via three key principles: (1) Reification of user-…	NR Nathalie Riche et al.Microsoft
AdRecommended Learn AI Coding at CodeNow Structured lessons, hands-on projects, and continuous updates for people bringing AI into real development work. Explore Now
emoji_events BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AI Today’s video-conferencing tools support a rich range of professional and social activities, but their generic meeting environments cannot be dynamically adapted to align with distributed collaborators’ needs. To enable end-user customization, we developed BlendScape, a rendering and composition system for video-confe…	SR Shwetha Rajaram et al.University of Michigan
SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending There is increased interest in using generative AI to create 3D spaces for virtual reality (VR) applications. However, today’s models produce artificial environments, falling short of supporting collaborative tasks that benefit from incorporating the user's physical context. To generate environments that support VR te…	NN Nels Numan et al.Parkview Health
Exploring the Design Space of Input Modalities for Working in Mixed Reality on Long-haul Flights Flexible working, including in resource-constrained settings such as long-haul flights, poses considerable challenges. While research in mixed reality (MR) offers the potential for enhancing experiences of working on airplanes (WoA), what input modalities and interactions might be suitable for such workspaces is under…	WM Wen Mo et al.University College London
emoji_events SharedNeRF: Leveraging Photorealistic and View-dependent Rendering for Real-time and Remote Collaboration Collaborating around physical objects necessitates examining different aspects of design or hardware in detail when reviewing or inspecting physical artifacts or prototypes. When collaborators are remote, coordinating the sharing of views of their physical environment becomes challenging. Video-conferencing tools ofte…	MS Mose Sakashita et al.Cornell University
Pixelated Interactions: Exploring Pixel Art for Graphical Primitives on a Tactile Display Two-dimensional pin array displays enable access to tactile graphics that are important for the education of students with visual impairments. Due to their prohibitive cost and limited access, there is limited research within HCI and the rules to design graphics on these low-resolution tactile displays are unclear. In…	TB Tigmanshu Bhatnagar et al.University College London
Style Blink: Exploring Digital Inking of Structured Information via Handcrafted Styling as a First-Class Object Structured note-taking forms such as sketchnoting, self-tracking journals, and bullet journaling go beyond immediate capture of information scraps. Instead, hand-drawn pride-in-craftmanship increases perceived value for sharing and display. But hand-crafting lists, tables, and calendars is tedious and repetitive. To s…	HR Hugo Romat et al.CNRS
AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware Armatures AirConstellations supports a unique semi-fixed style of cross-device interactions via multiple self-spatially-aware armatures to which users can easily attach (or detach) tablets and other devices. In particular, AirConstellations affords highly flexible and dynamic device formations where the users can bring multiple…	NM Nicolai Marquardt et al.Microsoft