Before you trust a benchmark, critique it
Kant asked what reason can know before using it to make claims. Peirce asked what difference a belief makes in practice. Applied to AI benchmarks, the two questions give a better test than any leaderboard.
Blog / Tag
Posts tagged #pragmatism.
Kant asked what reason can know before using it to make claims. Peirce asked what difference a belief makes in practice. Applied to AI benchmarks, the two questions give a better test than any leaderboard.