A pass threshold without a date is a mood
An eval result only constrains anyone if the bar was written down, dated, and published before the run. Everything else is a story told after the score came in.
Blog / Tag
Posts tagged #replication.
An eval result only constrains anyone if the bar was written down, dated, and published before the run. Everything else is a story told after the score came in.
Publishing "enough detail to replicate" means nothing if replication costs more than any outsider can spend. The real measure of a lab's openness is the price of checking it.