Darwin Family: VIDRAFT's Training-Free Model Merging Framework Hits 86.9% on GPQA Diamond

VIDRAFT, a Korean AI startup, has released Darwin Family, a training-free model merging framework that uses evolutionary algorithms to combine the parameters of two existing models. Their flagship model, Darwin-27B-Opus, achieved 86.9% on GPQA Diamond, ranking 6th globally among 1,252 models at publication time, outperforming its fully-trained parents. The framework is detailed in a preprint on arXiv.

TL;DR:VIDRAFT, a Korean AI startup, has published a framework calledDarwin Familythat improves LLM reasoning ability through evolutionary-algorithm-guided parameter recombination — no gradient training required. Their flagship model, Darwin-27B-Opus, scored 86.9% on GPQA Diamond and ranked 6th globally among 1,252 evaluated models at publication time, outperforming its fully-trained parent models. The preprint is available as arXiv:2605.14386. Darwin Family is a training-free model merging framework developed by the VIDRAFT research team in Seoul, Korea, and released as a preprint in May 2026 arXiv:2605.14386 . The core idea is borrowed from evolutionary biology: rather than spending millions of dollars retraining a new model from scratch, you can combine the weight parameters of two existing models — one strong generalist "Father" and one reasoning-specialized "Mother" — to produce a merged offspring that inherits the best capabilities of both. The name is a deliberate nod to Charles Darwin: the framework treats candidate merge configurations as individuals in a population, applies selection pressure, and evolves toward better-performing combinations over generations. Key properties at a glance: Darwin Family's technical contribution over naive parameter averaging rests on three cooperating mechanisms: 1. MRI Diagnostic Importance Scoring Before any merging happens, the framework "scans" every parameter layer in both parent models to estimate each layer's contribution to reasoning capability. This score is a composite of two signals: Both signals are weighted equally in the final per-layer importance score. That score then informs an initial recommended mixing ratio: the parent model with the higher score in a given layer contributes more of its parameters at that layer. 2. Evolutionary Search over a Genome Vector MRI scoring alone is an approximation — layer-by-layer diagnostics cannot fully capture cross-layer interactions. Darwin therefore uses an evolutionary search to refine the merge configuration. Each candidate merge recipe is encoded as a compact 14-dimensional genome vector , whose dimensions control things like global mixing ratios, attention-module ratios, feed-forward-network ratios, embedding layer ratios, per-parent sparsity, independent ratios for consecutive layer blocks, and an MRI trust weight. The evolutionary loop generates a population of candidate genomes, evaluates the resulting merged models, retains top performers, then applies crossover and mutation — iterating until the configuration converges. 3. MRI-Trust Fusion τ parameter A scalar parameter τ tau governs how much the final mixing ratio trusts the MRI diagnostic signal versus allowing the evolutionary search to freely explore. τ = 1 means full deference to MRI; τ = 0 means the evolutionary search operates unconstrained. Crucially, τ is not hand-tuned — it is itself part of the genome and learned by the evolutionary process. Across all tested model sizes, τ consistently converged to a range of roughly 0.35–0.55, empirically balancing diagnostic guidance with exploratory flexibility. All numbers below come directly from the source article: | Model | Benchmark | Score | Global Rank at publication | |---|---|---|---| | Darwin-27B-Opus | GPQA Diamond | 86.9% | 6th out of 1,252 models | The source article references the preprint at arXiv:2605.14386 as the primary public entry point. As of the article's publication date, no public Hugging Face model repository, GitHub codebase, or OpenAI-compatible API endpoint for Darwin Family was announced in this coverage. Check the arXiv paper directly for any links to released artifacts: https://arxiv.org/abs/2605.14386 If VIDRAFT publishes weights or tooling publicly, they would most likely appear on Hugging Face under the VIDRAFT organization. Watch that space. Q: Does Darwin Family require any training at all — even a small fine-tuning step? A: No. The entire process operates on fixed, pre-existing model weights. The evolutionary search evaluates candidate merge configurations using inference-time benchmark scores, not gradient-based optimization. No weight updates occur at any point. Q: Why does model merging work at all — shouldn't averaging parameters just produce noise? A: Research has shown that reasoning capabilities are largely encoded during pre-training and remain relatively stable through subsequent instruction tuning. Because both parent models share the same pre-trained base, their parameter spaces are geometrically compatible. Selective, importance-weighted merging can therefore recombine complementary capability "regions" rather than destructively averaging them. Q: Is the 14-dimensional genome design fixed, or can it be extended to more parent models? A: The source article describes a two-parent setup with a 14-dimensional genome. The paper arXiv:2605.14386 would be the authoritative source for any details about extensibility to additional parents or larger genome configurations. Originally reported by TechWalker 중국 2026-05-21 — source article.