Yi-Hao Peng

schoolCarnegie Mellon Universitybar_chart#575 Global Rank

Total Papers

HCI Rank

#575

Research Areas

Years Active

Recent Publications

StepWrite: Adaptive Planning for Speech-Driven Text Generation

People frequently use speech-to-text systems to compose short texts with voice. However, current voice-based interfaces struggle to support composing more detailed, contextually complex texts, especially in scenarios where users are on the move and cannot visually track progress. Longer-form communication, such as com…

UIST '251st AuthorIntelligent Voice Assistants (Alexa, Siri, etc.) +1

Morae: Proactively Pausing UI Agents for User Choices

User interface (UI) agents promise to make inaccessible or complex UIs easier to access for blind and low-vision (BLV) users. However, current UI agents typically perform tasks end-to-end without involving users in critical choices or making them aware of important contextual information, thus reducing user agency. Fo…

CHI '252nd AuthorGenerative AI (Text, Image, Music, Video) +1

CodeA11y: Making AI Coding Assistants Useful for Accessible Web Development

A persistent challenge in accessible computing is ensuring developers produce web UI code that supports assistive technologies. Despite numerous specialized accessibility tools, novice developers often remain unaware of them, leading to ~96% of web pages that contain accessibility violations. AI coding assistants, s…

UIST '242nd Author360° Video & Panoramic Content +2

UIClip: A Data-driven Model for Assessing User Interface Design

User interface (UI) design is a difficult yet important task for ensuring the usability, accessibility, and aesthetic qualities of applications. In our paper, we develop a machine-learned model, UIClip, for assessing the design quality and visual relevance of a UI given its screenshot and natural language description.…

DIS '245th+ AuthorAging-in-Place Assistance Systems +1

"This really let's us see the entire world:" Designing a conversational telepresence robot for homebound older adults

In this paper, we explore the design and use of conversational telepresence robots to help homebound older adults interact with the external world. An initial needfinding study (N=8) using video vignettes revealed older adults' experiential needs for robot-mediated remote experiences such as exploration, reminiscence…

UIST '232nd AuthorBest PaperGenerative AI (Text, Image, Music, Video) +1

GenAssist: Making Image Generation Accessible

Blind and low vision (BLV) creators use images to communicate with sighted audiences. However, creating or retrieving images is challenging for BLV creators as it is difficult to use authoring tools or assess image search results. Thus, creators limit the types of images they create or recruit sighted collaborators.…

CHI '231st AuthorVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)

Slide Gestalt: Automatic Structure Extraction in Slide Decks for Non-Visual Access

Presentation slides commonly use visual patterns for structural navigation, such as titles, dividers, and build slides. However, screen readers do not capture such intention, making it time-consuming and less accessible for blind and visually impaired (BVI) users to linearly consume slides with repeated content. We pr…

CHI '233rd AuthorDesign Fiction +1

Reality Rifts: Wonder-ful Interfaces by Disrupting Perceptual Causality

Reality Rifts are interfaces between the physical and the virtual reality, where incoherent observations of physical behavior lead users to imagine comprehensive and plausible end-to-end dynamics. Reality Rifts emerge in interactive physical systems that lack one or more components that are central to their operation,…

CHI '233rd AuthorVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille) +2

AVscript: Accessible Video Editing with Audio-Visual Scripts

Sighted and blind and low vision (BLV) creators alike use videos to communicate with broad audiences. Yet, video editing remains inaccessible to BLV creators. Our formative study revealed that current video editing tools make it difficult to access the visual content, assess the visual quality, and efficiently navi…

CHI '234th AuthorHonorable MentionUniversal & Inclusive Design +2

WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics

Modeling user interfaces (UIs) from visual information allows systems to make inferences about the functionality and semantics needed to support use cases in accessibility, app automation, and testing. Current datasets for training machine learning models are limited in size due to the costly and time-consuming proces…

View all 13 papers →

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/6562?source=all