Published January 27, 2025 | Version v1
Journal article Open

How can we make sound replication decisions?

  • 1. University of Missouri
  • 2. University of Amsterdam
  • 3. Eotvos Lorand University
  • 4. Aalto University
  • 5. Center for Open Science
  • 6. University of Groningen
  • 7. University of Chicago
  • 8. New York University
  • 9. Stanford University
  • 10. University of Zurich
  • 11. University of Texas at Austin
  • 12. Institute of Mind, Brain and Behavior
  • 13. Amsterdam University Medical Center
  • 14. University of Trento
  • 15. University of California, Irvine
  • 16. Norwegian University of Science and Technology

Description

Replication and the reported crises impacting many fields of research have become a focal point for the sciences. This has led to reforms in publishing, methodological design and reporting, and increased numbers of experimental replications coordinated across many laboratories. While replication is rightly considered an indispensable tool of science, financial resources and researchers' time are quite limited. In this perspective, we examine different values and attitudes that scientists can consider when deciding whether to replicate a finding and how. We offer a conceptual framework for assessing the usefulness of various replication tools, such as preregistration.

Data availability

There are no data underlying this work.

Files

davis-stober-et-al-2025-how-can-we-make-sound-replication-decisions.pdf

Additional details

Identifiers

DOI
10.1073/pnas.2401236121
Other
oai:uchicago.tind.io:14766

Funding

Department of Defense
W81XWH2110173
National Institutes of Health
R01AA030914
National Science Foundation
1230118
National Science Foundation
1658303
National Science Foundation
1850849
National Science Foundation
2051186
University of Chicago
University of Texas at Austin
Vidi
fellowship grant
National Science Foundation
1916518
National Science Foundation
1912270
National Science Foundation
1636893
National Science Foundation
1734853
National Institutes of Health
R01MH126699
National Institutes of Health
R01EB030896
National Institutes of Health
R01EB029272
Wellcome Trust
226486/Z/22/Z
Microsoft
Kavli Foundation
National Science Foundation
2106888
National Science Foundation
2146306
Defense Advanced Research Projects Agency
Norwegian Research Council
329730
Finnish Center for Artificial Intelligence
Academy of Finland
328813
Nokia Foundation
Jorma Ollila Mobility Grant

UChicago Information

Division(s)
Booth School of Business
Department(s)
Behavioral Science, Marketing