19:04
2026-09-18
developer.nvidia.com
large-language-models
Benchmarking LLM Inference at Scale with AIPerf
NVIDIA released AIPerf, a ground-up rewrite and designated successor to GenAI-Perf, as a multiprocessed LLM inference benchmarking tool that coordinates worker processes and record-processor services …