Q3.14
Novelty and learning effects
Cards in this group · 7
- Q3.14.1Metric movement right after a change may not last
- Q3.14.2Relearning costs for existing users pull metrics down for a while
- Q3.14.3The observation window has to outlast the transient
- Q3.14.4Novelty usually rises then falls; learning usually falls then rises
- Q3.14.5Telling novelty from learning takes a split by people; the blended curve confuses them
- Q3.14.6Engagement metrics absorb novelty more readily than task success does
- Q3.14.7After a major redesign the old baseline is gone; a new comparison period has to be built