Anthropic Changed the Sonnet 5 Chart After It Made Sonnet Look Bad

Anthropic altered the Sonnet 5 cost-performance chart after the initial version showed the model underperforming compared to Opus 4.8. The replacement chart presents a more favorable comparison.

Anthropic re-wrote the Sonnet 5 story post-launch. The first BrowseComp cost-performance chart showed Sonnet 5 lagging Opus 4.8. The replacement chart paints... Read More... Source