Skip to main content

Is there a reproducibility crisis in science? - Matt Anticole

  • 412,535 Views
  • 4,174 Questions Answered
  • TEDEd Animation

Let’s Begin…

Published scientific studies can motivate research, inspire products, and inform policy. However, recent studies that examined dozens of published pharmaceutical papers managed to replicate the results of less than 25% of them — and similar results have been found in other scientific disciplines. How do we combat this crisis of scientific irreproducibility? Matt Anticole investigates.

Create and share a new lesson based on this one.

About TED-Ed Animations

TED-Ed Animations feature the words and ideas of educators brought to life by professional animators. Are you an educator or animator interested in creating a TED-Ed Animation? Nominate yourself here »

Meet The Creators

  • Educator Matt Anticole
  • Director Brett Underhill
  • Animator Brett Underhill
  • Script Editor Alex Gendler
  • Narrator Pen-Pen Chen
Additional Resources for you to Explore
While there are many reasons why an experiment might be irreproducible, sometimes it is because of the fact that there was never really anything there in the first place. There are a variety of ways to analyze data that might lead an experimenter to decide the results are statistically significant when they actually are not.

A great introduction to this topic was produced by the crew over at Veritasium. While the discussion does get a little heavier on the math at times, the topic of ‘P-Hacking’ is introduced. P-Hacking occurs when researchers examine their data in specific ways that might lead to a higher chance of getting a ‘good’ result even when the data may not support it.

TED-Ed
Lesson Creator
New York, NY
Reproducibility is not a new concern. Paraphrased from a few years back; a famous scientist lamented, “This might surprise as much as dishearten, but you will meet with experiments which may, upon further trial, disappoint your expectation… either not at all succeeding constantly, or at least varying much from what you expected.” Who said this? The famous Irish scientist Robert Boyle… in 1673.
12/05/2016 • 
 5 Responses
 / 5 Updates

Customize this lesson

Create and share a new lesson based on this one.

About TED-Ed Animations

TED-Ed Animations feature the words and ideas of educators brought to life by professional animators. Are you an educator or animator interested in creating a TED-Ed Animation? Nominate yourself here »

Meet The Creators

  • Educator Matt Anticole
  • Director Brett Underhill
  • Animator Brett Underhill
  • Script Editor Alex Gendler
  • Narrator Pen-Pen Chen