Samenvatting
To overcome the frequently debated crisis of confidence, replicating studies is becoming increasingly more common. Multiple frequentist and Bayesian measures have been proposed to evaluate whether a replication is successful, but little is known about which method best captures replication success. This study is one of the first attempts to compare a number of quantitative measures of replication success with respect to their ability to draw the correct inference when the underlying truth is known, while taking publication bias into account. Our results show that Bayesian metrics seem to slightly outperform frequentist metrics across the board. Generally, meta-analytic approaches seem to slightly outperform metrics that evaluate single studies, except in the scenario of extreme publication bias, where this pattern reverses.
Originele taal-2 | English |
---|---|
Artikelnummer | 201697 |
Aantal pagina's | 16 |
Tijdschrift | Royal Society Open Science |
Volume | 8 |
Nummer van het tijdschrift | 5 |
DOI's | |
Status | Published - 2021 |
Vingerafdruk
Duik in de onderzoeksthema's van 'How best to quantify replication success? A simulation study on the comparison of replication success metrics'. Samen vormen ze een unieke vingerafdruk.Datasets
-
R results/data after simulation from How best to quantify replication success? A simulation study on the comparison of replication success metrics
Muradchanian, J. (Contributor), Hoekstra, R. (Contributor), Kiers, H. (Contributor) & Van Ravenzwaaij, D. (Contributor), The Royal Society, 10-mei-2021
DOI: 10.6084/m9.figshare.14564618
Dataset
-
R code to create Figures 3 - 7 from How best to quantify replication success? A simulation study on the comparison of replication success metrics
Muradchanian, J. (Creator), Hoekstra, R. (Creator), Kiers, H. (Creator) & Van Ravenzwaaij, D. (Creator), The Royal Society, 10-mei-2021
DOI: 10.6084/m9.figshare.14564612
Dataset
-
R code for data simulation from How best to quantify replication success? A simulation study on the comparison of replication success metrics
Muradchanian, J. (Contributor), Hoekstra, R. (Contributor), Kiers, H. (Contributor) & Van Ravenzwaaij, D. (Contributor), The Royal Society, 10-mei-2021
DOI: 10.6084/m9.figshare.14564615
Dataset