GLM 5.2 ranked last in code quality and equivalence among AI models tested on 50 real pull requests from Go and Rust repositories, while costing roughly twice as much as Composer 2.5. The model produc…
Composer 2.5 is 6.5x cheaper than premium models on Rust and Go PRs, but ranks last in code quality. Opus 4.8 leads in craft and local score, making it the best choice for complex tasks, while Compose…
Opus 4.8 outperformed GPT-5.5, Opus 4.7, and Composer 2.5 on 50 real pull request tasks from the graphql-go-tools and sqlparser-rs repositories, achieving the highest craft score in both Go and Rust. …
OpenAI's GPT-5.5 outperformed Anthropic's Opus 4.7 and OpenAI's GPT-5.4 on 56 real coding tasks from two open-source repositories, passing more tests and producing patches that more often survived cod…