helpResearch questionChart, Image, and Visual Content Accessibility
Why do multimodal vision-language models (VLMs) perform poorly on graphical user interface (UI) tasks?Direction: Accessibility and Assistive Technology
Chart, Image, and Visual Content Accessibility
Stats are based on currently indexed question data; missing sources remain visible.
117
items
30
sources
2025
latest
All questions
117 items
helpResearch questionChart, Image, and Visual Content Accessibility
How can high-quality image-text training data for UI tasks be generated without manual annotation?helpResearch questionChart, Image, and Visual Content Accessibility
What performance levels can improved multimodal models achieve in UI element recognition, description generation, and task planning?lightbulbPractical problemChart, Image, and Visual Content Accessibility
Users struggle to effectively understand complex interfaces, hindering automation and accessibility technology development.helpResearch questionChart, Image, and Visual Content Accessibility
What challenges and needs do blind users face when using generative AI for content generation such as natural language descriptions and extraction?helpResearch questionChart, Image, and Visual Content Accessibility
How can generative AI integrate with screen readers to improve blind users' efficiency in document processing?helpResearch questionChart, Image, and Visual Content Accessibility
How can generative AI interoperability be designed to support blind users without fully replacing screen readers?lightbulbPractical problemChart, Image, and Visual Content Accessibility
Blind users struggle to use document tools efficiently for charts or collaborative tasks.helpResearch questionChart, Image, and Visual Content Accessibility
How do current interactive seating maps fail to fully support ticket purchasing needs of people with disabilities?helpResearch questionChart, Image, and Visual Content Accessibility
How do people with disabilities adapt to design flaws in existing systems to complete ticket purchases?helpResearch questionChart, Image, and Visual Content Accessibility
Can shifting from user-category-based to seat-attribute-based seating design better meet disabled users' needs?lightbulbPractical problemChart, Image, and Visual Content Accessibility
People with disabilities cannot obtain sufficient accessibility information when buying tickets, making independent participation in public events difficult.helpResearch questionChart, Image, and Visual Content Accessibility
How can multimodal large language models combined with video accessibility guidelines improve clarity and accuracy of AI-generated video descriptions for blind or low vision users?helpResearch questionChart, Image, and Visual Content Accessibility
Can building a large dataset of high-quality video descriptions (e.g., VideoA11y-40K) significantly improve performance of existing multimodal language models?helpResearch questionChart, Image, and Visual Content Accessibility
Can AI-generated video descriptions better meet professional audio description standards than those produced by beginners?lightbulbPractical problemChart, Image, and Visual Content Accessibility
Blind users struggle to efficiently access video content information, and existing audio descriptions are scarce and costly.helpResearch questionChart, Image, and Visual Content Accessibility
How can accessibility of graphical tables be improved for blind and low vision (BLV) users?helpResearch questionChart, Image, and Visual Content Accessibility
How can interaction models enable BLV users to flexibly access table information?helpResearch questionChart, Image, and Visual Content Accessibility
How can complex structure and semantic information in graphical tables be accurately extracted and converted into understandable alt text?lightbulbPractical problemChart, Image, and Visual Content Accessibility
BLV users struggle to understand information in graphical tables.helpResearch questionChart, Image, and Visual Content Accessibility
How can dense video captioning generate efficient comic image descriptions to help visually impaired people?IUI '24"Generating Comic Image Descriptions Using Dense Video Captioning Techniques to Serve Visually Impaired Individuals"
helpResearch questionChart, Image, and Visual Content Accessibility
Can group processing effectively reduce redundant information in comic image descriptions compared with traditional single-image description methods?IUI '24"Generating Comic Image Descriptions Using Dense Video Captioning Techniques to Serve Visually Impaired Individuals"
helpResearch questionChart, Image, and Visual Content Accessibility
What content preferences do visually impaired users have for grouped comic descriptions, including needs for detail and background information?IUI '24"Generating Comic Image Descriptions Using Dense Video Captioning Techniques to Serve Visually Impaired Individuals"
lightbulbPractical problemChart, Image, and Visual Content Accessibility
Visually impaired users struggle to understand comic plots, and traditional single-image descriptions are redundant and inefficient.IUI '24"Generating Comic Image Descriptions Using Dense Video Captioning Techniques to Serve Visually Impaired Individuals"
helpResearch questionChart, Image, and Visual Content Accessibility
How can charts be converted from bitmap formats to accessible formats for blind and visually impaired users?helpResearch questionChart, Image, and Visual Content Accessibility
How can AI technologies (e.g., OCR and instance segmentation) support efficient chart metadata extraction and accessibility conversion?helpResearch questionChart, Image, and Visual Content Accessibility
How can user-friendly interfaces improve chart accessibility conversion efficiency and accuracy?lightbulbPractical problemChart, Image, and Visual Content Accessibility
Blind users struggle to access information in bitmap-format charts lacking metadata.helpResearch questionChart, Image, and Visual Content Accessibility
How can AI assist authors in writing high-quality alt text for cross-disciplinary scientific charts?helpResearch questionChart, Image, and Visual Content Accessibility
Can interactive generation methods effectively help authors iteratively improve scientific chart alt text?helpResearch questionChart, Image, and Visual Content Accessibility
What is the impact of combining metadata extraction with real-time user feedback on scientific chart alt text generation?lightbulbPractical problemChart, Image, and Visual Content Accessibility
Blind or low-vision readers struggle to understand complex charts in scientific papers.helpResearch questionChart, Image, and Visual Content Accessibility
How do existing image exploration systems meet multilevel information needs of BLV users in China?UbiComp '24AI-Vision: A Three-Layer Accessible Image Exploration System for People with Visual Impairments in China
helpResearch questionChart, Image, and Visual Content Accessibility
Can the AI-Vision system improve BLV users' image exploration through multimodal interaction?UbiComp '24AI-Vision: A Three-Layer Accessible Image Exploration System for People with Visual Impairments in China
helpResearch questionChart, Image, and Visual Content Accessibility
Can multilevel information design improve usability and adaptability of image systems?UbiComp '24AI-Vision: A Three-Layer Accessible Image Exploration System for People with Visual Impairments in China
lightbulbPractical problemChart, Image, and Visual Content Accessibility
BLV users struggle to efficiently obtain complete semantic and detailed image information.UbiComp '24AI-Vision: A Three-Layer Accessible Image Exploration System for People with Visual Impairments in China
helpResearch questionChart, Image, and Visual Content Accessibility
How does spatial audio (e.g., pitch and stereo channel adjustments) enhance blind and low-vision users' ability to explore and understand complex graphics on touchscreens?helpResearch questionChart, Image, and Visual Content Accessibility
How does multimodal feedback (including vibration, sound, and text descriptions) help blind users efficiently identify data trends?helpResearch questionChart, Image, and Visual Content Accessibility
Compared with traditional auditory feedback, what are the advantages and disadvantages of spatial audio for perceiving data trends in complex graphics (e.g., bar charts and scatter plots)?lightbulbPractical problemChart, Image, and Visual Content Accessibility
Blind users struggle to intuitively explore and understand data trends in complex graphics on touchscreens.helpResearch questionChart, Image, and Visual Content Accessibility
Do differences in children's visual ability affect how they understand emotional expression conveyed by deformable devices?helpResearch questionChart, Image, and Visual Content Accessibility
How do children associate tactile stimulation with emotion?helpResearch questionChart, Image, and Visual Content Accessibility
How do different shapes and dynamics (e.g., tentacles and spikes) affect the intensity and category of emotions children perceive?lightbulbPractical problemChart, Image, and Visual Content Accessibility
Visually impaired children struggle to perceive emotion through images or video, affecting technology interaction experience.helpResearch questionChart, Image, and Visual Content Accessibility
How can higher-quality alt text for AI-generated images be designed for BLV users?helpResearch questionChart, Image, and Visual Content Accessibility
What alt text requirements do unique characteristics of AI-generated images (e.g., style blending and generation bias) impose?helpResearch questionChart, Image, and Visual Content Accessibility
How do alt text from different sources (generation prompts, creator-written, expert-written, auto-generated) differ in quality?lightbulbPractical problemChart, Image, and Visual Content Accessibility
BLV users struggle to understand AI-generated image content, and existing alt text is insufficient or unclear.helpResearch questionChart, Image, and Visual Content Accessibility
How can enhanced audio description improve blind or low-vision users' understanding and immersion in video content?helpResearch questionChart, Image, and Visual Content Accessibility
Is a layered interactive mechanism in enhanced audio description more effective than traditional static audio description?Related papers
IUI 2025
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations
Yue Jiang, Eldon Schoop, Amanda Swearngin
CHI 2025
The Sky is the Limit: Understanding How Generative AI can Enhance Screen Reader Users' Experience with Productivity Applications
Minoli Perera, Swamy Ananthanarayan, Cagatay Goncu
CHI 2025
"Is This Seat Accessible for Me?": An Autoethnography of a Person With a Mobility Disability Using Interactive Seat Plans for Public Events
Lukas Strobel, Kathrin Gerling, Jan Ole Rixen
CHI 2025
VideoA11y: Method and Dataset for Accessible Video Description
Chaoyu Li, Sid Padmanabhuni, Maryam S Cheema
CHI 2025
TableNarrator: Making Image Tables Accessible to Blind and Low Vision People
Ye Mo, Gang Huang, liangcheng li
IUI 2024
Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion
Omar Moured, Morris Baumgarten-Egemole, Karin Müller
IUI 2024
FigurA11y: AI Assistance for Writing Scientific Alt Text
Nikhil Singh, Lucy Lu Wang, Jonathan Bragg
CHI 2024
Spatial Audio-Enhanced Multimodal Graph Rendering for Efficient Data Trend Learning on Touchscreen Devices
Wilfredo Joshua Robinson Moore, Medhani Kalal, Jennifer L. Tennison
CHI 2024
Conveying Emotions through Shape-changing to Children with and without Visual Impairment
Isabel Neto, Yuhan Hu, Filipa Correia
CHI 2024
From Provenance to Aberrations: Image Creator and Screen Reader User Perspectives on Alt Text for AI-Generated Images
Maitraye Das, Alexander J. Fiannaca, Meredith Ringel Morris
CHI 2024
SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers
Zheng Ning, Brianna L Wimer, Kaiwen Jiang
CHI 2024
Making Short-Form Videos Accessible with Hierarchical Video Summaries
Tess Van Daele, Akhil Iyer, Yuning Zhang