{"slug": "revolut-cut-ai-coding-costs-90-by-self-hosting-glm", "title": "Revolut cut AI coding costs 90% by self-hosting GLM", "summary": "Revolut cut its AI coding inference costs by roughly 90 percent by self-hosting the open-weight GLM model on 56 Nvidia B200 GPUs instead of paying commercial APIs, David Abitbol, who leads ops and infrastructure at Revolut, said at the AI Engineer conference in New York, as reported by The Register on 3 November. Self-hosting GLM-5.1 cost $0.30 per million input and output tokens, about a tenth of what Codex or Claude Code cost the 2,000-engineer fintech, and tuning — NVFP4 quantization, disaggregated prefill and decode, and context-length work — raised requests per second 76 percent and cut time to first token 88 percent, from 14.26 seconds to 1.68 seconds, on the same hardware. Abitbol said the 90 percent figure is an inference cost comparison rather than total cost of ownership, and that coding speed rose 60 percent and lead time 70 percent by Revolut's own measurement.", "body_md": "A fintech with 2,000 engineers moved its default coding model off commercial APIs and onto its own GPUs, and says the bill fell by roughly **90 percent** in under a year.\n\nDavid Abitbol, who leads ops and infrastructure at Revolut, described the migration at the AI Engineer conference in New York, and The Register reported it on 3 November. The company had run Gemini from early 2025 and Claude Code from early 2026, with strict token budgets because the numbers did not make sense. *“We were highly skeptical about the cost of AI. We were seeing engineers spend $1,000 a month, $10,000 a month with not so much ROI.”*\n\n## What they run\n\nRevolut started on GLM-5.1 and moved to **GLM-5.3**, served on **56 Nvidia B200 GPUs**, the equivalent of seven eight-GPU DGX B200 systems. Self-hosting GLM-5.1 came in at **$0.30 per million input and output tokens**, about a tenth of what Codex or Claude Code cost them.\n\nThe model is not small. GLM-5.1 is roughly **754 billion parameters with 40 billion active per token**, needs about **380GB of GPU memory** to hold the weights, and another 6 to 26GB per user for context. That is a data center deployment, not a workstation one, and it is the reason the savings require capital rather than a subscription.\n\n## The tuning mattered more than the hardware\n\nAbitbol’s most useful claim for anyone running inference at scale is that adding GPUs was not what fixed performance. The gains came from **hyperparameter tuning, switching to NVFP4 quantization, disaggregating prefill from decode, and tuning context lengths**.\n\nThe result is on a slide with the GPU count held constant: tuning from the migration setup to a stable eight-way tensor-parallel configuration raised requests per second by **76 percent** and cut time to first token by **88 percent**, from **14.26 seconds to 1.68 seconds**, on the same 56 B200s. Adding GPUs would not have produced that curve, and Abitbol’s advice is to resist buying more before the existing fleet is tuned.\n\nThen the line that will annoy every vendor selling a million-token window: *“Long context is a scam. You really need to be mindful of that. Even though you can serve one million tokens, 256 [thousand] is really what you need.”*\n\nThe targets they tuned toward are concrete: **under 3 seconds to first token at a 256,000-token context, and about 200 tokens per second** of generation. *“As soon as you exceed 5 seconds, my Slack inbox starts to blow up.”* Engineers signing in after 5pm see closer to 800 tokens per second because the fleet is idle.\n\n## The part that surprised them\n\nCoding speed improved **60 percent** and lead time **70 percent**, by Revolut’s own measurement, and Abitbol says the bottleneck was never the code. The gains came from letting the model handle debugging, Jira tickets and Confluence pages, work nobody had budgeted tokens for before.\n\n*“When you have unlimited tokens, you’re free to do that. You no longer have to save your tokens for the end of the quarter or the most difficult task.”*\n\nThat is the real argument for ownership, and it is behavioural rather than financial. A metered API does not just cost money, it shapes what people ask for.\n\n## What it does not prove\n\n**The 90 percent is an inference cost comparison, not a total cost of ownership.** Fifty-six B200s is seven figures of hardware before power, rack space and the engineers who keep it serving. At low utilisation the maths inverts, which is the case every small team should check before copying this.\n\n**The 60 and 70 percent figures are self-reported** with no control group, and “coding time” is a metric companies measure generously.\n\n**GLM is text only**, so Revolut routes vision work to Gemini and GPT Luna through a model router. Code generation runs on the Chinese model; the frontier models are still on the bill, just less often.\n\nAbitbol addressed the obvious security question directly: the concern with Chinese open weights is calling their APIs inside China, not running the files on your own hardware or regional cloud.\n\n## Why this lands now\n\nIt is the clearest public case for a position the industry has been arguing about all year, and it arrived in the same fortnight as Microsoft publishing an Ignite session titled “How much should you own?” Revolut answered with a number.\n\nSources: [AI Engineer: the talk and full transcript](https://ai.engineer/talks/Ok6QdZHCcI8-revolut-cut-ai-coding-costs-90-self) - [The Register report](https://www.theregister.com/ai-and-ml/2026/11/03/british-fintech-revolut-slashes-ai-coding-costs-10x-by-cutting-out-claude-and-going-self-hosted/5307345) - [GLM-5.3 model card](https://huggingface.co/zai-org/GLM-5.3) - [vLLM disaggregated prefill](https://docs.vllm.ai/en/latest/features/disagg_prefill.html)\n\nRelated on this site: [Microsoft demos Hermes at Ignite without announcing it](https://tokenstead.ai/guides/hermes-microsoft-ignite)", "url": "https://wpnews.pro/news/revolut-cut-ai-coding-costs-90-by-self-hosting-glm", "canonical_source": "https://tokenstead.ai/guides/revolut-self-hosted-glm", "published_at": "2026-11-20 03:59:54+00:00", "updated_at": "2026-11-20 04:43:12.980559+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-tools", "large-language-models"], "entities": ["Revolut", "David Abitbol", "GLM-5.1", "GLM-5.3", "Nvidia B200", "Gemini", "Claude Code", "The Register"], "also_reported_by": [], "takeaway": "On a fixed fleet of 56 B200s, hyperparameter tuning, NVFP4 quantization, disaggregated prefill/decode and context-length tuning raised requests per second 76 percent and cut time to first token from 14.26 seconds to 1.68 seconds, so tune the existing fleet before buying more GPUs.", "recommendation": {"advice": "Tune the existing GPU fleet — hyperparameters, NVFP4 quantization, disaggregated prefill/decode and context lengths — before buying more hardware; Revolut gained 76 percent more requests per second and an 88 percent lower time to first token on the same 56 B200s.", "playbook": "inference-serving", "playbook_url": "https://wpnews.pro/playbooks/inference-serving"}, "alternates": {"html": "https://wpnews.pro/news/revolut-cut-ai-coding-costs-90-by-self-hosting-glm", "markdown": "https://wpnews.pro/news/revolut-cut-ai-coding-costs-90-by-self-hosting-glm.md", "text": "https://wpnews.pro/news/revolut-cut-ai-coding-costs-90-by-self-hosting-glm.txt", "jsonld": "https://wpnews.pro/news/revolut-cut-ai-coding-costs-90-by-self-hosting-glm.jsonld"}}