corpus | multi-evidence claims | replicated (SUPPORTS+SUPPORTS) | contested (SUPPORTS+REFUTES) | contested fraction
Camerer et al. 2016, Science, doi:10.1126/science.aaf0918 | 18 | 11 | 7 | 0.389
   quote: "We found a significant effect in the same direction as in the original study for 11 replications (61%)"
Camerer et al. 2018, Nature Human Behaviour, doi:10.1038/s41562-018-0399-z | 21 | 13 | 8 | 0.381
   quote: "We find a significant effect in the same direction as the original study for 13 (62%) studies"
Open Science Collaboration 2015, Science, doi:10.1126/science.aac4716 | 97 | 36 | 61 | 0.629
   quote: "Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results"
Climate-FEVER (finding 2) | retrieval corpus | contested fraction 0.195
SciFact-Open (finding 2) | retrieval corpus | contested fraction 0.185

prediction (>=35% in replication corpora): HOLDS
falsification (<25% in two of three): not triggered
OSC 2015 per-study (OSF master data): 92 significant originals, 34 replicated (p<.05 same direction) -> contested 58/92 = 0.630; by the CI criterion 52/92 = 0.565
note: Camerer 2016 (7/18) and Camerer 2018 (8/21) are exact from the abstracts' counts; OSC 2015 is now per-study.
