UI Remix: Supporting UI Design Through Interactive Example Retrieval and Remixing
Authors
Designing user interfaces (UIs) is a critical step when launching products, building portfolios, or personalizing projects, yet end users without design expertise often struggle to articulate their intent and to trust design choices. Existing example-based tools either promote broad exploration, which can cause overwhelm and design drift, or require adapting a single example, risking design fixation. We present UI Remix, an interactive system that supports mobile UI design through an example-driven design workflow. Powered by a multimodal retrieval-augmented generation (MMRAG) model, UI Remix enables iterative search, selection, and adaptation of examples at both the global (whole interface) and local (component) level. To foster trust, it presents source transparency cues such as ratings, download counts, and developer information. In an empirical study with 24 end users, UI Remix significantly improved participants' ability to achieve their design goals, facilitated effective iteration, and encouraged exploration of alternative designs. Participants also reported that source transparency cues enhanced their confidence in adapting examples. Our findings suggest new directions for AI-assisted, example-driven systems that empower end users to design with greater control, trust, and openness to exploration.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 86%
Prototyping with Prompts: Emerging Approaches and Challenges in Generative AI Design for Collaborative Software Teams
CHI '25· Generative AI (Text, Image, Music, Video) +2
- 86%
CritiqueCrew: Orchestrating Multi-Perspective Conversational Design Critique
CHI '26· Creative Collaboration & Feedback Systems +2
- 86%
Creating Design Resources to Scaffold the Ideation of AI Concepts
DIS '23· Generative AI (Text, Image, Music, Video) +2
- 75%
Tracing Everyday AI Literacy Discussions at Scale: How Online Creative Communities Make Sense of Generative AI
CHI '26· Generative AI (Text, Image, Music, Video) +2
- 71%
MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling
CHI '24· Generative AI (Text, Image, Music, Video) +1
- 71%
Productive vs. Reflective: How Different Ways of Integrating AI into Design Workflows Affect Cognition and Motivation
CHI '25· Human-LLM Collaboration +1
- 71%
How the Role of Generative AI Shapes Perceptions of Value in Human-AI Collaborative Work
CHI '25· Generative AI (Text, Image, Music, Video) +1
- 63%
ReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Models
CHI '24· Voice User Interface (VUI) Design +2
- 63%
AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation
CHI '24· Generative AI (Text, Image, Music, Video) +1
- 63%
Design Principles for Generative AI Applications
CHI '24· Generative AI (Text, Image, Music, Video) +2
Based on Jaccard similarity of research subtopics & professions (≥60%)