METR: Anthropic redacted much of the "most informative" evidence from METR's 100-page report, so readers "must rely on our judgment more than we consider ideal" (@metr_evals)

2 days ago 10
Add to circle

@metr_evals:
METR: Anthropic redacted much of the “most informative” evidence from METR's 100-page report, so readers “must rely on our judgment more than we consider ideal”  —  We submitted a ~100-page full report on our assessment to Anthropic. For the public version, Anthropic redacted a majority of the evidence we found most informative. As a consequence, the public must rely on our judgment more than we consider ideal.

Read Entire Article