Mingyuan Zhong

schoolUniversity Of Washingtonbar_chart#877 Global Rank

Total Papers

HCI Rank

#877

Research Areas

Years Active

Recent Publications

SusBench: An Online Benchmark for Evaluating Dark Pattern Susceptibility of Computer-Use Agents

As LLM-based computer-use agents (CUAs) begin to autonomously interact with real-world interfaces, understanding their vulnerability to manipulative interface designs becomes increasingly critical. We introduce SusBench, an online benchmark for evaluating the susceptibility of CUAs to UI dark patterns, designs that ai…

CHI '261st AuthorVoice Accessibility +2

TaskAudit: Detecting Functiona11ity Errors in Mobile Apps via Agentic Task Execution

Accessibility checkers are tools in support of accessible app development, and their use is encouraged by accessibility best practices. However, most current checkers evaluate static or mechanically-generated contexts, failing to capture common accessibility errors impacting mobile app functionality. In this work, we…

UIST '253rd AuthorExplainable AI (XAI) +2

SlideAudit: A Dataset and Taxonomy for Automated Evaluation of Presentation Slides

Automated evaluation of specific graphic designs like presentation slides is an open problem. We present SlideAudit, a dataset for automated slide evaluation. We collaborated with design experts to develop a thorough taxonomy of slide design flaws. Our dataset comprises 2400 slides collected and synthesized from multi…

CHI '251st AuthorGenerative AI (Text, Image, Music, Video) +2

ScreenAudit: Detecting Screen Reader Accessibility Errors in Mobile Apps Using Large Language Models

Many mobile apps are inaccessible, thereby excluding people from their potential benefits. Existing rule-based accessibility checkers aim to mitigate these failures by identifying errors early during development but are constrained in the types of errors they can detect. We present ScreenAudit, an LLM-powered system d…

MOBILEHCI '242nd AuthorMotor Impairment Assistive Input Technologies +2

The Ability-Based Design Mobile Toolkit (ABD-MT): Developer Support for Runtime Interface Adaptation Based on Users' Abilities

Despite significant progress in the capabilities of mobile devices and applications, most apps remain oblivious to their users' abilities. To enable apps to respond to users' situated abilities, we created the Ability-Based Design Mobile Toolkit (ABD-MT). ABD-MT integrates with an app's user input and sensors to obser…

CHI '222nd AuthorVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)

Ga11y: an Automated GIF Annotation System for Visually Impaired Users

Animated GIF images have become prevalent in internet culture, often used to express richer and more nuanced meanings than static images. But animated GIFs often lack adequate alternative text descriptions, and it is challenging to generate such descriptions automatically, resulting in inaccessible GIFs for blind or l…

CHI '222nd AuthorVoice Accessibility +2

A Large-Scale Longitudinal Analysis of Missing Label Accessibility Failures in Android Apps

We present the first large-scale longitudinal analysis of missing label accessibility failures in Android apps. We developed a crawler and collected monthly snapshots of 312 apps over 16 months. We use this unique dataset in empirical examinations of accessibility not possible in prior datasets. Key large-scale findin…

UIST '211st AuthorInteractive Data Visualization +1

HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based Instructions

We present HelpViz, a tool for generating contextual visual mobile tutorials from text-based instructions that are abundant on the web. HelpViz transforms text instructions to graphical tutorials in batch, by extracting a sequence of actions from each text instruction through an instruction parsing model, and executin…

CHI '214th AuthorVoice User Interface (VUI) Design +1

ProxiMic: Convenient Voice Activation via Close-to-Mic Speech Detected by a Single Microphone

Wake-up-free techniques (e.g., Raise-to-Speak) are important for improving the voice input experience. We present ProxiMic, a close-to-mic (within 5 cm) speech sensing technique using only one microphone. With ProxiMic, a user keeps a microphone-embedded device close to the mouth and speaks directly to the device with…

CHI '211st AuthorCrowdsourcing Task Design & Quality Control +1

Spacewalker: Rapid UI Design Exploration Using Lightweight Markup Enhancement and Crowd Genetic Programming

User interface design is a complex task that involves designers examining a wide range of options. We present Spacewalker, a tool that allows designers to rapidly search a large design space for an optimal web UI with integrated support. Designers first annotate each attribute they want to explore in a typical HTML pa…

Quick Actions

Share this page

ios_share

X in mail

https://hci.top/en/authors/6430?source=all