The path from theory to study consists of a thousand decisions, big and small. How and how much do these decisions matter? We discuss a recent crowdsourced meta-study that tried to find out. Fifteen teams of researchers were given 5 different hypotheses and told to design a study to test them, then they ran all the studies and got widely varying results. What are the implications of this study for how we should think about the role of theory in study design? What does it say about the different functions of direct and conceptual replications? Is this evidence of hidden moderators? How predictable were the differences in results, and were they predictable because of differences in the study designers' expertise, biases, or something else? Plus: We answer a letter about getting scooped on a systematic review.
The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at email@example.com. You can subscribe to us on iTunes or Stitcher.
Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.
This is episode 75. It was recorded on January 30, 2020.
You Took the Words Right Out of My Mouth
They Give You This, But You Pay For That
An Award-Winning Episode
Does Not Compute
The Impending Fall of Academia
Joe Public, Will You Marry Me?
Just Be Cause
The Expertise of Death
Going Off the Record
The Year 2019 in Review
Letting Loose Your Inner Reviewer Two
The Last Straw
Talk the Talk
Everybody Act Normal
Copyright © 2006-2021 Podbean.com