What Evolves When We Talk about Harness Evolution

Aug 6, 2026

Harness evolution makes benchmark scores rise, but the score is not the whole story. We decompose each observed gain into overfitting, test-time scaling, and generalizable improvement — and find much of it does not transfer.