{"slug": "recursive-flint-40b-coding-model-for-your-laptop", "title": "Recursive Flint: 40B Coding Model for Your Laptop", "summary": "Recursive released Flint, a 40-billion-parameter coding model under the Apache 2.0 license that runs locally on Apple Silicon Macs, generating 131 tokens per second on an M4 Pro with 48GB of unified memory through MLX. Flint uses a Mixture-of-Experts architecture with 39.8 billion total parameters and about 2.5 billion active per token, routing each token to 6 of 256 experts plus one shared expert, and Recursive says its Eureka Machine automated research system chose the architecture and wrote the Apple Silicon and RTX Spark inference kernels, compressing development to four months versus a typical 12–18 months. Recursive's self-reported benchmarks include 89.7% on SWE-bench Pro v2, 74.2% on SWE-bench Verified, 54.9% on Terminal-Bench 2.1, 80.3% on LiveCodeBench v6 and 95.1% on IFEval in BF16, though no independent evaluation had been published as of late October 2026, and the official rec launcher requires an M4 Pro, M5 Pro or M5 Max with at least 48GB of unified memory.", "body_md": "Recursive just dropped Flint, a 40-billion parameter coding model that runs entirely on a MacBook Pro, generates 131 tokens per second, and doesn’t send your code anywhere. It’s Apache 2.0. And it was largely designed by Recursive’s own AI research system. That last detail is worth unpacking.\n\n## MoE Is What Makes This Possible\n\nFlint uses a [Mixture-of-Experts (MoE) architecture](https://huggingface.co/blog/moe): 39.8 billion total parameters, but only about 2.5 billion are active for each token. The model routes each token to 6 of its 256 experts — plus one always-on shared expert — rather than running everything through the full network. You get the knowledge of a 40B model at the compute cost of a much smaller one.\n\nThat’s why the speed numbers are real. On an M4 Pro with 48GB of unified memory, Flint writes 131 tokens per second through MLX. Dense local models at comparable quality typically run at 15–25 tok/s. This is a 5–10x difference, and it’s the gap that makes local deployment practical for agentic workflows rather than just demo toys.\n\n## The AI That Designed Itself\n\nRecursive’s Eureka Machine is an automated research system that runs the full ML loop autonomously: propose, implement, test, iterate — across many parallel threads. For Flint, the Eureka Machine chose the architecture. It started from a 35B/3B baseline, explored expert counts and widths, and converged on 40B total / 2.5B active as the optimal tradeoff for coding speed and accuracy. It also wrote the Apple Silicon and RTX Spark inference kernels.\n\nFlint was built in four months. A comparable model development cycle at a traditional lab takes 12–18 months. That delta is the Eureka Machine’s contribution, and it makes Flint as much a proof of AI-driven model development as it is a coding tool in its own right.\n\n## The Numbers — With an Honest Caveat\n\nRecursive reports these benchmark scores:\n\n| Benchmark | Flint Score | \n|---|---|\n| SWE-bench Pro v2 | 89.7% | \n| SWE-bench Verified | 74.2% | \n| Terminal-Bench 2.1 | 54.9% | \n| LiveCodeBench v6 | 80.3% | \n| IFEval (BF16) | 95.1% | \n\nThe caveat: these are self-reported. No independent evaluation had been published as of late October 2026. The 89.7% [SWE-bench Pro v2](https://www.swebench.com) figure is a strong claim from a lab still building its track record. For comparison, Qwen 3.8 — a dense 27B model — scores 94.9% on that same benchmark and beats Flint on four of six coding evals. Flint’s main advantage over Qwen 3.8 isn’t accuracy; it’s speed and offline operation.\n\n## The 48GB Wall\n\nRecursive’s rec launcher — the official way to run Flint — only supports the M4 Pro, M5 Pro, or M5 Max with 48GB or more of unified memory. Most M4 Pro MacBook Pros ship in 24GB and 36GB configurations. The 48GB config is the top-of-line option.\n\nIf you don’t have 48GB, there are workarounds:\n\n- The mlx-community 3-bit build runs in about 17.8GB — usable on a 24GB machine, with some accuracy loss\n- Unsloth’s UD-Q4_K_XL GGUF is 25.1GB, workable on a 24GB GPU with VRAM and RAM offloading\n- On Windows or Linux with an RTX 3090 (24GB), 3-bit quants run at around 46 tok/s via llama.cpp\n\n## How to Run It\n\nThree paths, in order of ease:\n\n**Mac with 48GB — rec engine:**\n\n```\ncurl -fsSL https://raw.githubusercontent.com/recursive-oss/rec/main/install.sh | bash\nrec launch pi\n```\n\n**Any OS — Ollama:**\n\n```\nollama run flint:40b\n```\n\n**llama.cpp or LM Studio:** Download GGUF weights from [Hugging Face](https://huggingface.co/recursive-ai/flint), load in [llama.cpp build b11803](https://github.com/ggml-org/llama.cpp/releases/tag/b11803) or later. Flint support merged October 21 (PR #30928).\n\nFor agentic workflows, Flint drops into OpenHands, Cline, and Aider via their local model backends — point them at your Ollama or llama.cpp server and you have a fully offline coding agent.\n\n## Who Should Care\n\nFlint is for three groups specifically. First: developers on 48GB M4/M5 Pro MacBooks who want to stop paying per-token for routine coding work. At 131 tok/s, it keeps up with a fast typist. Second: teams with real privacy requirements — financial, legal, healthcare codebases where sending source to a cloud API is a non-starter. Third: anyone running agentic workflows who needs high throughput at zero marginal cost.\n\nIf you’re on a standard 16GB or 36GB MacBook, or need vision capabilities, Flint isn’t there yet. And if you need independently verified benchmarks before committing, that’s a reasonable position to hold.\n\n## Bottom Line\n\nFlint isn’t the best coding model available — Qwen 3.8 beats it on accuracy with a smaller footprint. But it is likely the fastest capable coding model you can run locally today, and it’s free, private, and Apache 2.0. For anyone who clears the 48GB bar, this is worth running now.\n\nThe Eureka Machine story adds something most model releases don’t: Flint is a data point that AI-driven model development works at this scale. That story is going to get more interesting with each iteration — Recursive has already said the next version starts from Flint as its baseline.", "url": "https://wpnews.pro/news/recursive-flint-40b-coding-model-for-your-laptop", "canonical_source": "https://byteiota.com/recursive-flint-40b-coding-model/", "published_at": "2026-11-15 00:07:19+00:00", "updated_at": "2026-11-15 01:52:17.338582+00:00", "lang": "en", "topics": ["large-language-models", "ai-research", "ai-tools", "ai-agents", "developer-tools"], "entities": ["Recursive", "Flint", "Eureka Machine", "Apple", "MLX", "Qwen 3.8", "Hugging Face", "llama.cpp"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/recursive-flint-40b-coding-model-for-your-laptop", "markdown": "https://wpnews.pro/news/recursive-flint-40b-coding-model-for-your-laptop.md", "text": "https://wpnews.pro/news/recursive-flint-40b-coding-model-for-your-laptop.txt", "jsonld": "https://wpnews.pro/news/recursive-flint-40b-coding-model-for-your-laptop.jsonld"}}