L6.09

Feedback Loops and Preference Entrenchment

Cards in this group · 5

  1. L6.09.1The system only observes items it showed; unshown items never receive positive feedback
  2. L6.09.2Early accidental clicks get amplified into durable profile features
  3. L6.09.3Users adjust behaviour to get the recommendations they want, so behavioural data lose representativeness
  4. L6.09.4Breaking the loop needs active exploration; the cost is immediate and the benefit is delayed
  5. L6.09.5Offline evaluation on historical logs systematically favours the policy that produced those logs