{"slug": "now-nvidia-loses-on-speed-nvidia-s-own-model-2-45x-faster-on-macs", "title": "Now Nvidia loses on speed – Nvidia's own model 2.45x faster on Macs", "summary": "Fenon AI reported that four MacBook Pros running NVIDIA's GR00T N1.7 robot policy served 192 concurrent clients 2.45x faster than the fastest published single-request H100 figure and 4.24x faster than NVIDIA's own published H100 number, in a benchmark dated November 13, 2026. Fenon AI said the four MacBook Pros list at $19,996 versus at least $25,000 for one H100 card, but acknowledged the H100 is faster for one request at a time and that the H100 figures came from others' published results rather than its own runs. Under the 192-client load, half of responses returned within 1,275 ms and all 1,536 requests returned valid actions with 0 errors, though Fenon AI said it fell short of its target of 100 chunks per second per Mac and that no robot actually moved during the test.", "body_md": "## Team\n\nWe are a small team with our own mathematics and a Tensor Engine built from the ground up.\n\nWe are driven by theories, architectures and measurements. Two of our papers are on our\n[Publication](https://nuketorch.ai/publication/) page.\n\n## Founder’s Note\n\nFor about ten years I led a team that built an engine for wash sale, one of the heaviest number-crunching jobs in Wall Street tax.\n\nWhen I met the Transformer, it was a shock. A few billion calculations in a few seconds. To me it was not coding but pure mathematics infused in a machine. I was but a frog in a well.\n\nI designed a few forms of pipeline parallelism in PyTorch. All were too fragile and did not perform. Nothing in the mathematics blocked it. One thing I believe is that mathematics does not lie. The fragility had to be in the execution, but I could not see what failed or where. So around Halloween of 2025, we started our own Tensor Engine.\n\nIt was a fun and brutal ride.\n\nToday we are proud to bring pipeline parallelism to practical reality. A small start. We would like to believe we changed the future a little.\n\nNovember 13, 2026\n\n# Robotics: Macs 2.45x faster than NVIDIA H100 on NVIDIA’s own model\n\nWhen did you last see NVIDIA with enough RAM lose to Macs on speed? No, we are not talking about power efficiency or about a large model that never fit on a single card.\n\nGR00T is a popular robot model made by NVIDIA. NVIDIA published its performance on an H100\n[here](https://github.com/NVIDIA/Isaac-GR00T). Then\n[Fenon AI](https://www.fenon.ai/blogs/gr00t-n1-7-h100-inference) topped it\nalso on an H100. The question is: can NVIDIA’s own model on a highly optimized setup lose on speed to Macs? Read on\nfor the result, the method and how to run it yourself.\n\nHere is the result.\n\n## How we did it\n\nA robot policy looks through the robot’s cameras and answers with the next chunk of actions. One answer is one chunk: the model predicts 40 action steps, and the client uses 16.\n\nA room of robots does not need one fast answer. It needs many answers at once. So many robots share one model. Requests that are waiting are answered together, up to 16 in one model call. Each Mac holds its own copy of the model and serves its own 48 clients.\n\nInside one answer, three things happen. A vision part reads the two camera frames. A language part reads the instruction and the robot’s state. Then the action part, a diffusion transformer, turns that into motion in 4 denoising steps.\n\nThe model’s values are NVIDIA’s, unchanged, in 16-bit. We changed how the engine runs them. In our\nreport’s words, the build used “M5 FP16 projections, Neural Accelerator vision attention, packed DiT\nprojections and scratch reuse.” Together they took one request from 62.66 ms on our starting build to 44.34\nms: 1.41× faster. The engine is the same one as in [our first article](#one-vs-four).\n\nHere is the run on four MacBook Pros.\n\n## Now the honest part\n\nThe H100 figures are published by others, for one request at a time. We did not run them, and nobody has published an H100 rate for many requests at once. Ours is 192 clients at once, on four machines against one card.\n\nFor one request at a time, the H100 is faster. Its HBM memory has more bandwidth, and that is superior for a single robot’s inference. If you have one robot, the H100 wins.\n\nWhen you have many robots, four MacBook Pros serve them 2.45× faster than the fastest H100 figure in print, and 4.24× faster than NVIDIA’s own published figure.\n\nAnd the price. Four of these MacBook Pros list at $19,996. One H100 card costs at least $25,000, and you cannot run an H100 by itself.\n\nOur own target was 100 chunks a second per Mac. We did not reach it.\n\nNo robot moved. Recorded camera frames went in, and actions came out. This is how fast the policy answers, not how well a robot does its task.\n\nUnder the 192-client load, half of the answers came back within 1,275 ms. All 1,536 requests in the measured run\nreturned valid actions, with 0 errors. The details are in our\n[GR00T report](https://nuketorch.ai/reports/groot-four-m5-max.pdf).\n\n## Run it yourself\n\nThe one-Mac version is a free download. Get NukeTorch and the GR00T bundle, and follow the GR00T part of the README. Start the server with the policy beside a text model, and run the built-in benchmark. It sets your run beside ours.\n\nOn one MacBook Pro M5 Max with 48 GB, we measured 37.2 chunks a second with 16 clients, and 44.8 ms for one request at a time. If you have a more capable Mac, we would love to hear what result you get.\n\nFor the multi-machine version, please request an evaluation license:\n[\\[email protected\\]](https://nuketorch.ai/cdn-cgi/l/email-protection#44272b2a30252730042a312f21302b36272c6a252d7b3731262e212730790a312f21102b36272c617674213225283125302d2b2a617674282d27212a3721)\n\n## What it means\n\nA robot lab without a specialized data center. Four laptops on a desk, on wall power, with no rack, no external fans and no liquid cooling, running inference for 192 robots. No waiting for a power permit.\n\nRobotics has our full attention. Please share with us what you need most: more robots per machine, a faster single answer, or another policy model.\n\nSpeed is our passion. Our questions were:\n\n1. How much can software fill the gap left by missing high-bandwidth HBM memory?\n2. Is the NVIDIA chip simply better, HBM or not?\n\nGR00T was one study of whether similarly priced consumer MacBooks can win on **speed** against highly\noptimized NVIDIA hardware.\n\nNovember 12, 2026\n\n# One MacBook Pro beat Apple’s four Mac Studios at WWDC26 LoRA fine-tuning\n\nMost analysts estimate that about four of every five AI chips sold are NVIDIA’s. NVIDIA’s hold is even stronger in training large models. It can look like a sacred realm, where almost no one else is allowed to set foot. We thought: do we have a chance?\n\nAt WWDC 2026, Apple shared a training [video](https://developer.apple.com/videos/play/wwdc2026/233/?time=1090). Apple used data\nparallelism to LoRA fine-tune Qwen3.5-9B on four M3 Ultra machines. So we did it too. Same job. Same recipe. Same\nWikiSQL training steps. We wanted to see how our NukeTorch stacks up.\n\nHere is the result.\n\n|  | Apple, WWDC26 | NukeTorch | \n|---|---|---|\n| One machine | ~180 tokens/s One M3 Ultra Mac Studio | 1,440.8 tokens/s One MacBook Pro M5 Max, 48 GB | \n| Four machines | ~600 tokens/s Four M3 Ultra Mac Studios | 5,358.5 tokens/s Four MacBook Pro M5 Max, 48 GB each | \n| Method on four machines | Data parallel | Pipeline parallel | \n| 1,000 steps on four machines | About 40½ minutes at that speed | Under 5 minutes | \n\n* One machine trains 4 examples per step and four machines train 16, as in Apple’s two commands. The machines\ndiffer, and Apple’s figures are the ones spoken in its session. We did not run Apple’s setup. The details\nare in our [one-Mac report](https://nuketorch.ai/reports/qwen-9b-one-mac.pdf) and our\n[four-Mac report](https://nuketorch.ai/reports/qwen-9b-fine-tuning.pdf), and you can watch the\nfour-Mac run in our [video demo](https://www.youtube.com/watch?v=XG8tV_RL8OA).\n\n## How we did it\n\nThere are two parts: speed and pipeline. The speed comes from the engine, and two of its ideas are published.\n\n### Unfolding\n\nA tensor’s values are fixed. How they are stored and read is a choice. Unfolding is changing that choice.\n\nMemory is one line. Several values share one machine word, and a kernel takes a handful of values at a time. If its handful is spread over many words, it fetches many words to use a few values. If a word holds c values and the kernel makes m draws, the words it must fetch, Φ, obey:\n\nm ≤ Φ ≤ c·m\n\nUnfolding moves the store to the low end, Φ = m. A real case: a public four-bit model packs eight neighbouring codes into each 32-bit word, but each lane of our decode kernel takes every 32nd code. Unfolded, the eight codes a lane needs share one word, and word fetches fall from 256 to 32 per block.\n\nYou can also leave the file alone and redraw the kernel. On one matrix, a test kernel that reads the file as it is ran 4.9× faster than our engine’s loop: 516 GB per second, 94% of the 546 GB per second that Apple states for the chip.\n\nIt was a journey of discovery. First we credited a gain to the order of the values. After many iterations we learned that most of the gain came from the form of the kernel’s loop.\n\nThe detail is in our paper,\n[*Unfolding: Theory and Principles*](https://nuketorch.ai/papers/unfolding-theory-and-principles.pdf). If\nthere is enough interest, I can write another article about it, so you do not have to read all 27 pages\nyourself.\n\n### Shaping neural simulation\n\nWe call any neural network running on any device a neural simulation. A matrix product in it has three axes: rows M, output width N, and reduction length K, the number of products summed into each output value.\n\nWe expected the size of a program to set its speed. It did not. The rate was set by one axis, the length of the sum K. Past a knee, doubling K halves the rate. So we cut one long sum into P shorter ones and add the partial sums.\n\nOn that layer pair, shaping raised the rate 3.12 to 3.46×, while cutting by output channels left it at 0.99 to 1.00×. With the same change, Whisper large-v3-turbo transcription took 21.5% and 21.9% less time on an M4 Max and an M5 Max. It does not always help: at one row per call, the split gains at most 3.4%.\n\nThe full detail is in\n[*Understanding the Shapes of Neural Simulation*](https://nuketorch.ai/papers/understanding-the-shapes-of-neural-simulation.pdf),\n28 pages. Again, I can write another article if needed.\n\nOne honest note. Both papers measure inference, and we have not yet published a breakdown of the training speed.\n\n### Pipeline parallelism\n\nWe named ours the Choo-Choo Relay Train. Like a train, it connects machines in a line, with a single Thunderbolt\ncable between them. You can see our setup in the video on our [X](https://x.com/NukeTorchAI).\n\nThe usual way to use four machines is data parallel: every machine holds the whole model. Apple’s WWDC26 run was data parallel. In a pipeline, each machine holds only its assigned layers, and together they work as one distributed machine. It does not make a single prompt faster. Our speed comes from the mathematics.\n\n- **It keeps the speed.** Four Macs ran at 93% of four single Macs.\n- **It uses a fraction of the memory.** Spread a model over N machines, and each needs 1/N of the\nRAM for the weights that data parallelism needs.\n- **It uses less energy.** 7.3% less per trained token than our own data parallelism on the same\nfour Macs. Boring? That was Apple to Apple, pun intended. Next we will compare the same model on NVIDIA and AMD.\n\n## Run it yourself\n\nThe one-Mac trainer is in the free download. Get NukeTorch and the training bundle and follow the README: one command, about five minutes, and it prints your tokens per second. It is free to download and use under our license.\n\nOn a MacBook Pro M5 Max with 48 GB the download trained at up to 1,242.0 tokens/s, the best of our five runs;\ntheir median was 1,195.4. That is not the 1,440.8 in the table, which is from our report and video demo. The version\nthat pipelines several machines is by invitation:\n[\\[email protected\\]](https://nuketorch.ai/cdn-cgi/l/email-protection#8ae9e5e4feebe9fecae4ffe1effee5f8e9e2a4ebe3b5f9ffe8e0efe9feb7c4ffe1efdee5f8e9e2afb8baeffcebe6ffebfee3e5e4afb8bae6e3e9efe4f9ef)\n\n## What it means\n\nPipeline parallelism has long been our north star. A model no longer has to fit in one machine.\n\nWe designed the Choo-Choo Relay Train for the AI data center. Our goal is a line of machines, each holding just a single layer of a large model. No single pool of memory that must hold the whole model. No special interconnects, which are costly and labor-intensive. Each machine needs only enough RAM for its one layer, and a cable or two to its neighbours.\n\n## Acknowledgement\n\nFor a small team like ours, it would not have been possible without the contributions of others: the amazing CUDA community, open-source models like Qwen, the sea of knowledge deposited in arXiv, the oMLX community, where many of our models were sourced, the personal AI machines of Apple, and the explosion of frontier AI models, whom we acknowledge not as tools but as partners.\n\nWe hope to contribute back to the fundamental acceleration of Intelligence.", "url": "https://wpnews.pro/news/now-nvidia-loses-on-speed-nvidia-s-own-model-2-45x-faster-on-macs", "canonical_source": "https://nuketorch.ai/blog/#mac-vs-nvidia", "published_at": "2026-11-13 13:33:56+00:00", "updated_at": "2026-11-13 13:51:21.880976+00:00", "lang": "en", "topics": ["robotics", "ai-infrastructure", "machine-learning"], "entities": ["Fenon AI", "NVIDIA", "GR00T", "H100", "MacBook Pro", "PyTorch"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/now-nvidia-loses-on-speed-nvidia-s-own-model-2-45x-faster-on-macs", "markdown": "https://wpnews.pro/news/now-nvidia-loses-on-speed-nvidia-s-own-model-2-45x-faster-on-macs.md", "text": "https://wpnews.pro/news/now-nvidia-loses-on-speed-nvidia-s-own-model-2-45x-faster-on-macs.txt", "jsonld": "https://wpnews.pro/news/now-nvidia-loses-on-speed-nvidia-s-own-model-2-45x-faster-on-macs.jsonld"}}