Compensation changes participant composition
Aliases: research compensation · participation incentive · payment selection effect
What it is
Incentive-induced sample composition means that amount, payment form, conditions, and delay alter who applies, who can absorb participation costs, and who completes. Low compensation may exclude people with high time value, care obligations, or travel cost. Higher compensation can broaden access while also attracting applicants motivated mainly by income. Payment is therefore part of recruitment design, not an administrative detail after the study.
Why it happens
Potential participants compare expected benefit with time, travel, privacy, fatigue, and opportunity cost. Those costs differ across groups, so one amount does not create equal participation probability. Payment forms also select: gift cards require usable retailers, delayed transfers require trust, and lotteries replace certain compensation with risk preference. Performance-contingent pay changes in-study behavior by rewarding speed, correctness, or researcher approval rather than the participant’s ordinary goal.
Studying it
Derive budgets from session, preparation, waiting, travel or data cost, task burden, and locally fair rates. Recruitment pilots may compare amounts or framing on click-through, eligibility, attendance, attrition, composition, suspicious applications, and evidence quality rather than optimizing only the cheapest completion. Report amount, currency, payment timing, prorating, and policies for incomplete sessions so the induced selection can be assessed.
Where it stops holding
High payment does not automatically produce poor data or undue influence, and low payment is not more authentic. Ethical analysis asks whether payment overwhelms risk judgment, fairly covers burden, and avoids penalizing withdrawal. Scarce professionals may require higher compensation to improve rather than reduce representation. In sensitive studies, payment records or reward types can reveal identity even at a fair amount, so privacy-preserving options matter.
Applying it
- Compensate preparation, waiting, travel, and follow-up rather than counting interview minutes alone.
- Separate guaranteed compensation from performance bonuses and avoid tying core pay to a “correct” answer.
- Track the segmented funnel from invitation to completion; if a higher amount increases duplicate or ineligible applications, improve verification rather than assuming lower pay is fairer.
- Collect brief refusal or withdrawal reasons to detect exclusion caused by payment form, delay, or opportunity cost.