OpenAI documented a single Codex run that went for about 25 hours uninterrupted, burned roughly 13 million tokens, and produced around… Continue reading on Towards AI »
source & further reading
pub.towardsai.net — original article
How Diffusion LLMs Write 64 Words at Once on an A100 GPU
Model Routing with NVIDIA’s NeMo Switchyard
Key Takeaways From Trying to Do It All With One LLM Call