Cohere's 30B Coding Agent Beats Models 4x Its Size on One H100 — and It Shouldn't

Cohere's 30-billion-parameter coding agent, with only 3 billion active parameters, achieved a score of 0.6 on a benchmark, outperforming models four times its size while running on a single H100 GPU.

A 30-billion-parameter model with only 3 billion active parameters has no business landing 0.6 Continue reading on Towards AI »