To Search or To Gen? Design Dimensions Integrating Web Search and Generative AI in Programmers' Information-Seeking Process
Authors
Programmers now use both generative AI (GenAI) and traditional web search for information-seeking, yet how these tools are used individually or in combination remains unclear. To answer this, we conducted a multi-phase investigation, including retrospective interviews to identify foraging behaviours and challenges and an observational study with a technology probe to analyze how contextual information flows across tools. Our findings reveal that effective information-seeking requires adaptable strategies and varying levels of contextual detail. Building on these insights, we propose five design dimensions for developing tools that integrate web search, GenAI, and code editors. We further demonstrated the generative power of these design dimensions with a proof-of-concept prototype, validated through a user study, offering actionable design implications for enhancing integrated information-seeking workflows across web search and GenAI in programming.
Research Questions / Practical Problems
Question signals indexed for this paper.
- 75%
Rethinking Dataset Discovery with DataScout
UIST '25· Human-LLM Collaboration +1
- 67%
End User Authoring of Personalized Content Classifiers: Comparing Example Labeling, Rule Writing, and LLM Prompting
CHI '25· Human-LLM Collaboration +1
- 60%
On the Design of AI-powered Code Assistants for Notebooks
CHI '23· Human-LLM Collaboration +2
- 60%
Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming
CHI '24· Human-LLM Collaboration +2
- 60%
'A Modern Up-To-Date Laptop' - Vagueness in Natural Language Queries for Product Search
DIS '20· Human-LLM Collaboration +1
Based on Jaccard similarity of research subtopics & professions (≥60%)