An eval that has seen the answers is a memory test
Benchmark contamination doesn't just inflate scores. It changes what the score measures. Cutting live internet access from evals fixes one leak and leaves the bigger one, the training data, untouched.