Correction
Benchmarks are moving into the real world
The earlier article presented a general claim about evaluation trends as a statement from Hugging Face. Its blog index did not establish that claim, so we withdraw the attribution.
Anthropic distinguishes an agent transcript from the outcome in the environment. Its guide discusses checking whether a task actually succeeded. This supports a narrower discussion of evaluation design, not the original attribution or an industry-wide trend.
This notice replaces the earlier text. The original URL is retained so readers can see the correction. The reference below was checked during this review and is not presented as the original article's source.