Tip: press / anywhere to search. Or open a random note →

Handwritten notebook page explaining the replication crisis in psychology: what replication means, the 2015 rerun of 100 studies (97% worked first time, 36% on rerun), Many Labs 2 and Nature and Science results, effects shrinking by about half, ego depletion tested in 23 labs, why it happened, and a checklist for judging a claim
Tap the note to see it full size

Psychology One-page note

The Replication Crisis in One Page

Some of psychology's most famous findings didn't hold up when scientists ran them again. Here's what happened and how to spot a solid claim. Save this page.

Good to know

Open Science Collaboration 2015; Many Labs 2 (Klein et al. 2018); Camerer et al. 2018; Hagger et al. 2016; Simmons et al. 2011.

What's on the page

The note as text, so you can read it, copy it or use a screen reader.

What it is

  • Rerun a published study: same result?
  • Many famous findings didn't repeat
  • Psychology tested itself in the 2010s

The big tests

  • 2015: 100 studies rerun
  • 97% "worked" first time, 36% on rerun
  • 2018: 28 findings, 36 countries: about half
  • 2018: 21 Nature & Science studies: 13 repeated

Effects shrank too

  • Rerun effects about half the original size
  • Ego depletion: 23 labs, one test, found almost nothing

Why it happened

  • Flexible analysis can make chance look real
  • Some original effects were inflated
  • Some originals were false positives

How to judge a claim

  • Has it been repeated by others?
  • Big sample? Pre-registered?
  • One eye-catching study isn't proof
  • Failing once doesn't prove it's false

More from Psychology

All Psychology notes →