HCI.TOPHCI, made easy

arrow_backBack to questions View categoryarrow_forward

Accessibility and Assistive Technology / Chart, Image, and Visual Content Accessibility

Can the AI-Vision system improve BLV users' image exploration through multimodal interaction?

helpResearch questionChart, Image, and Visual Content Accessibility

Can the AI-Vision system improve BLV users' image exploration through multimodal interaction?

UbiComp '24AI-Vision: A Three-Layer Accessible Image Exploration System for People with Visual Impairments in China

Similar questions

helpResearch questionChart, Image, and Visual Content Accessibility

Why do multimodal vision-language models (VLMs) perform poorly on graphical user interface (UI) tasks?

IUI '25ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations

helpResearch questionChart, Image, and Visual Content Accessibility

How can high-quality image-text training data for UI tasks be generated without manual annotation?

IUI '25ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations

helpResearch questionChart, Image, and Visual Content Accessibility

What performance levels can improved multimodal models achieve in UI element recognition, description generation, and task planning?

IUI '25ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations

helpResearch questionChart, Image, and Visual Content Accessibility

What challenges and needs do blind users face when using generative AI for content generation such as natural language descriptions and extraction?

CHI '25The Sky is the Limit: Understanding How Generative AI can Enhance Screen Reader Users' Experience with Productivity Applications

helpResearch questionChart, Image, and Visual Content Accessibility

How can generative AI integrate with screen readers to improve blind users' efficiency in document processing?

CHI '25The Sky is the Limit: Understanding How Generative AI can Enhance Screen Reader Users' Experience with Productivity Applications

helpResearch questionChart, Image, and Visual Content Accessibility

How can generative AI interoperability be designed to support blind users without fully replacing screen readers?

CHI '25The Sky is the Limit: Understanding How Generative AI can Enhance Screen Reader Users' Experience with Productivity Applications

Related papers

ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations

Yue Jiang, Eldon Schoop, Amanda Swearngin

The Sky is the Limit: Understanding How Generative AI can Enhance Screen Reader Users' Experience with Productivity Applications

Minoli Perera, Swamy Ananthanarayan, Cagatay Goncu

"Is This Seat Accessible for Me?": An Autoethnography of a Person With a Mobility Disability Using Interactive Seat Plans for Public Events

Lukas Strobel, Kathrin Gerling, Jan Ole Rixen

VideoA11y: Method and Dataset for Accessible Video Description

Chaoyu Li, Sid Padmanabhuni, Maryam S Cheema

TableNarrator: Making Image Tables Accessible to Blind and Low Vision People

Ye Mo, Gang Huang, liangcheng li

Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion

Omar Moured, Morris Baumgarten-Egemole, Karin Müller

FigurA11y: AI Assistance for Writing Scientific Alt Text

Nikhil Singh, Lucy Lu Wang, Jonathan Bragg

Spatial Audio-Enhanced Multimodal Graph Rendering for Efficient Data Trend Learning on Touchscreen Devices

Wilfredo Joshua Robinson Moore, Medhani Kalal, Jennifer L. Tennison

Conveying Emotions through Shape-changing to Children with and without Visual Impairment

Isabel Neto, Yuhan Hu, Filipa Correia

From Provenance to Aberrations: Image Creator and Screen Reader User Perspectives on Alt Text for AI-Generated Images

Maitraye Das, Alexander J. Fiannaca, Meredith Ringel Morris

SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers

Zheng Ning, Brianna L Wimer, Kaiwen Jiang

Making Short-Form Videos Accessible with Hierarchical Video Summaries

Tess Van Daele, Akhil Iyer, Yuning Zhang