Anthropic detailed its internal methods for measuring the pace of AI progress, shifting away from public benchmarks toward scaling laws, generalization gaps, and continuous internal evaluation loops t…
AIPerf is a dedicated benchmarking tool that measures LLM inference performance by generating concurrent request loads, according to a first-person account of using it to test deployments. The account…
NVIDIA released AIPerf, a ground-up rewrite and designated successor to GenAI-Perf, as a multiprocessed LLM inference benchmarking tool that coordinates worker processes and record-processor services …
SemiAnalysis's AgentX benchmark shows NVIDIA's Vera Rubin NVL72 delivers up to 30x higher AI-factory throughput per megawatt than GB300 NVL72 for agentic-coding inference, while GB300 NVL72 extends it…