Q
Research Methods and Evaluation
Research Planning
56 cards- Framing research questions 3
- Exploratory and confirmatory research 3
- Choosing qualitative and quantitative methods 3
- Sampling and representativeness 3
- Participant recruitment 3
- Research ethics 3
- Researcher bias 3
- Sample size 3
- Exploratory and confirmatory research in practice 4
- Three-dimensional classification of research methods 4
- Participant recruitment and screening 4
- Incentives and incentive-induced bias 4
- Informed consent and research ethics 4
- Researcher bias and leading questions 4
- Sample-size heuristics and misuse 4
- Time and budget constraints in research 4
Qualitative Methods
56 cards- User interviews 3
- Contextual inquiry 3
- Diary studies 3
- Ethnography and field observation 3
- Focus groups 3
- Usability testing 4
- Think-aloud methods 3
- Cognitive walkthrough 3
- Heuristic evaluation 3
- Expert review 3
- Card sorting 3
- Tree testing 3
- Co-design workshops 3
- Focus groups and their limitations 4
- Facilitation skills and neutrality 4
- Remote and asynchronous testing 4
- Competitive analysis and benchmarking 4
Quantitative Methods
79 cards- Questionnaire design 3
- System Usability Scale 3
- Net Promoter Score 3
- A/B testing 4
- Multivariate testing 3
- Task success rate 3
- Task completion time 3
- Error rate and help-seeking 3
- Eye-tracking experiments 3
- Physiological measurement 3
- Log and instrumentation analysis 7
- Funnel and retention analysis 7
- Significance and practical importance 3
- Novelty and learning effects 7
- Questionnaires and rating scales 4
- Single-item and short scales 4
- Recommendation-style metrics and their controversies 4
- Experimental design and controls 4
- Statistical significance and effect size 4
- Multiple comparisons and result picking 4
Analysis and Research Outputs
58 cards- Affinity diagramming 3
- Coding and thematic analysis 3
- Personas 3
- User journey maps 7
- Service blueprints 3
- Scenarios and storyboards 3
- Task analysis 3
- Jobs-to-be-done theory 3
- Ranking opportunities 3
- Transferability of conclusions 7
- Intercoder agreement 4
- Hierarchical task analysis 4
- Mental model diagrams 4
- Identifying opportunities 4
- Communicating and acting on findings 4
Prototyping and Validation
37 cardsMeasurement Systems
42 cards- Classification frameworks 3
- Goals–Signals–Metrics 3
- North star metrics 3
- Experience and business metrics 3
- Metric manipulability 3
- Long term and short term 3
- Experience measurement frameworks 4
- Relating experience and business metrics 4
- Metric gaming and proxy distortion 4
- Long-term effects versus short-term metrics 4
- Benchmarks and competitive comparison 4
- Continuous tracking and alerting 4