#reproducibility on Hacker News

2 stories tagged reproducibility, newest first.

Screenshot of blog.everydayscientist.com: Replace peer review with “peer replication” (2021)

Replace peer review with “peer replication” (2021)(blog.everydayscientist.com)

537 points by dongping 3 years ago | 320 comments

A 2021 Everyday Scientist blog post arguing that traditional peer review should be replaced by "peer replication," where independent labs reproduce published findings.

peer-review replication-crisis scientific-publishing reproducibility

Screenshot of kenschutte.com: Bad numbers in the “gzip beats BERT” paper?

Bad numbers in the “gzip beats BERT” paper?(kenschutte.com)

341 points by ks2048 3 years ago | 109 comments

Blog post arguing the "gzip beats BERT" text classification paper reports top-2 accuracy instead of kNN(k=2) accuracy due to a code bug, inflating results.

gzip knn text-classification bert