home / team-science

combination

Data license: Space charter; records cite primary sources · Data source: TeamScience Space repository

3 rows

✎ View and edit SQL

This data as json, CSV (advanced)

Suggested facets: claim_a, created_ts (date)

id ▼ claim_a claim_b bridge statement falsify status created_ts
ts-combo-contested-by-evidence-source ts-claim-cf1-contested-claim-level ts-claim-rc1-contested-fraction-by-evidence-source   Contestedness is a property of the evidence-gathering process, not of science: retrieval corpora ~20%, replication corpora ~40–60%; the retrieval number measures what annotators find, the replication number measures what experiments find. A replication corpus re-scored with retrieval-style evidence (papers citing the original) also gives ~20%, or a retrieval corpus restricted to replication studies gives ~40%+. ready_to_test 2026-09-02T18:17:15Z
ts-combo-contested-claims-claim-level ts-claim-cf1-contested-claim-level ts-claim-so1-contested-after-open-retrieval ts-concept-polarity-concordance In open-retrieval claim-verification corpora the contested fraction among claims with two or more polar evidence documents is about 0.2, independent of the number of documents and of domain; closed citation-built corpora show about 0 by construction, not because scientific claims are uncontested. A fourth open-retrieval corpus with >=2 polar documents per claim whose contested fraction falls outside 12-28% or whose trend in k has z > 1.6; or SciFact-Open's contested fraction rising above 35% as evidence per claim grows; or independence overprediction below 2x in any such corpus. ready_to_test 2026-09-02T15:10:00Z
ts-combo-listwise-collapse-is-noisy-argmax ts-claim-mg1-noisy-tournament-selection ts-claim-z1-listwise-collapse-global-discrimination ts-concept-noisy-argmax Accuracy@1 of an LLM pairwise judge over N unexecuted ML candidates equals the noisy-argmax accuracy of a Thurstone case-V comparator at the judge's pairwise accuracy; no additional listwise 'global discrimination' deficit is needed to explain Zheng Table 3, and the same arithmetic bounds RPM child-selection as N grows. Pre-registered: at p=0.59 the model predicts Acc@1 = 0.221 (N=8), 0.191 (N=10), 0.146 (N=15). A re-run of Zheng's ranking subset at those N with Acc@1 more than 2 SE below these values falsifies the combination; matching values within 2 SE support it. Second test: an RPM/AIRA-dojo tournament with N children whose selection accuracy tracks these curves. ready_to_test 2026-09-02T02:30:00Z

Advanced export

JSON shape: default, array, newline-delimited, object

CSV options:

CREATE TABLE combination (
  id          TEXT PRIMARY KEY,      -- ts-combo-<slug>
  claim_a     TEXT NOT NULL REFERENCES claim(id),
  claim_b     TEXT NOT NULL REFERENCES claim(id),
  bridge      TEXT REFERENCES concept(id),
  statement   TEXT NOT NULL,
  falsify     TEXT NOT NULL,
  status      TEXT NOT NULL CHECK (status IN ('proposed','ready_to_test','contradicted','withdrawn')),
  created_ts  TEXT NOT NULL,
  CHECK (claim_a < claim_b)
);
Powered by Datasette · Queries took 7.779ms · Data license: Space charter; records cite primary sources · Data source: TeamScience Space repository