UI Remix: Supporting UI Design Through Interactive Example Retrieval and Remixing

Prototyping & User TestingGenerative AI (Text, Image, Music, Video)Human-LLM CollaborationCreative Collaboration & Feedback SystemsUI/UX DesignersSoftware Engineers & DevelopersAI/ML Researchers & Engineers

Designing user interfaces (UIs) is a critical step when launching products, building portfolios, or personalizing projects, yet end users without design expertise often struggle to articulate their intent and to trust design choices. Existing example-based tools either promote broad exploration, which can cause overwhelm and design drift, or require adapting a single example, risking design fixation. We present UI Remix, an interactive system that supports mobile UI design through an example-driven design workflow. Powered by a multimodal retrieval-augmented generation (MMRAG) model, UI Remix enables iterative search, selection, and adaptation of examples at both the global (whole interface) and local (component) level. To foster trust, it presents source transparency cues such as ratings, download counts, and developer information. In an empirical study with 24 end users, UI Remix significantly improved participants' ability to achieve their design goals, facilitated effective iteration, and encouraged exploration of alternative designs. Participants also reported that source transparency cues enhanced their confidence in adapting examples. Our findings suggest new directions for AI-assisted, example-driven systems that empower end users to design with greater control, trust, and openness to exploration.

Quick Actions

Share

Share this page

ios_share

https://hci.top/en/papers/iui/226601/2026

AdRecommended

Learn AI Coding at CodeNow

At a Glance

Paper Snapshot

fact_check
dataset
Source
IUI
calendar_month
Year
2026
emoji_events
Award
No award tagged
group
Authors
5 authors
sell
Subtopics
Prototyping & User Testing, Generative AI (Text, Image, Music, Video), Human-LLM Collaboration, Creative Collaboration & Feedback Systems
work
Professions
UI/UX Designers, Software Engineers & Developers, AI/ML Researchers & Engineers
article
Content Status
Abstract only
hub
Related Papers
10 related papers