{"slug": "i-shipped-an-llm-efficiency-security-kernel-and-deleted-my-own-best-idea", "title": "I shipped an LLM efficiency + security kernel — and deleted my own best idea", "summary": "A solo developer shipped BIOMA, a local LLM security and efficiency kernel written in Rust with a Python layer, after deleting their original 'mitosis' idea that failed to improve correctness in measured tests. BIOMA hardens LLM payloads in-process before they leave the machine, using mechanisms like metabolic context pruning and an atomic in-memory signaling substrate. The project is source-available under FSL-1.1-MIT and auto-converts to MIT after two years.", "body_md": "Six months ago I set out to make LLMs \"smarter\" by orchestrating many of them\n\ntogether. I measured it. It didn't work. Here's what I shipped instead — and why\n\nthe failure is the part I'm proudest of.\n\nThe plan was **\"mitosis\"**: split a task across several LLMs, let them multiply and\n\ncompete, then synthesize the best answer. It sounds great in a pitch deck.\n\nOn ground-truth **executed tests**, it made correctness *worse*:\n\nEvery gain was ≤ 0. So I deleted it. The full evaluation — including the failure —\n\nis in the repo's `FINDINGS.md`\n\n.\n\nThe lesson: an idea that survives a *pitch* is not the same as an idea that\n\nsurvives a *measurement*.\n\n**BIOMA** is a small, local, provider-agnostic kernel (Rust core + a thin Python\n\nlayer) that sits in front of any LLM call and hardens the payload **in-process,\nbefore it leaves your machine**.\n\n``` python\nfrom bioma.firewall_client import CognitiveFirewall\n\nfw = CognitiveFirewall(vault={\"db_password\": DB_PW})   # secrets to protect\nh = fw.shield(history, \"refactor this function\")\n#   h.prompt / h.system  -> clean, dehydrated, secret-free payload\n#   h.telemetry          -> saturation, red_alert, apoptosis_reduction, kernel_latency_us\n\nimport anthropic                                        # or google.genai, or openai\nmsg = anthropic.Anthropic().messages.create(\n    model=\"claude-sonnet-5\", max_tokens=1024,\n    system=h.system or \"\", messages=[{\"role\": \"user\", \"content\": h.prompt}])\n```\n\nThree mechanisms, all measured:\n\nEach context block gets a metabolic weight and a half-life; low-value blocks (old\n\nlogs, resolved chatter) are purged before dispatch.\n\n`0x0F`\n\nred alert → apoptosis.An atomic in-memory signalling substrate (~5µs) carries the alert state.\n\n(Throughput benched at ~2M signals/s.)\n\nAnthropic, Google, OpenAI, or a local model — same layer. You harden the payload\n\nhere and hand it to *your* SDK.\n\nThe license is **FSL-1.1-MIT**: the code is **source-available** (read it, run it,\n\nbuild on it), free for any **non-competing** use, and it **auto-converts to MIT\nafter two years**. I'm a solo dev — I wanted it visible and auditable without\n\nBIOMA isn't magic. The whole thing is one discipline: **measure everything, and\nkeep only what survives the measurement** — even when that means deleting the\n\nRepo (Rust + Python, benchmarks, and the honest `FINDINGS.md`\n\n):\n\n[https://github.com/jonathascordeiro20/bioma-framework](https://github.com/jonathascordeiro20/bioma-framework)\n\nWhat would you attack first? I'll be in the comments — especially happy to go deep\n\non the firewall's saturation heuristic or the mitosis eval.", "url": "https://wpnews.pro/news/i-shipped-an-llm-efficiency-security-kernel-and-deleted-my-own-best-idea", "canonical_source": "https://dev.to/jonathas_cordeiro/i-shipped-an-llm-efficiency-security-kernel-and-deleted-my-own-best-idea-nhi", "published_at": "2026-07-13 22:06:40+00:00", "updated_at": "2026-07-13 22:50:43.743800+00:00", "lang": "en", "topics": ["large-language-models", "ai-safety", "developer-tools", "ai-infrastructure"], "entities": ["BIOMA", "Anthropic", "Google", "OpenAI", "Claude"], "alternates": {"html": "https://wpnews.pro/news/i-shipped-an-llm-efficiency-security-kernel-and-deleted-my-own-best-idea", "markdown": "https://wpnews.pro/news/i-shipped-an-llm-efficiency-security-kernel-and-deleted-my-own-best-idea.md", "text": "https://wpnews.pro/news/i-shipped-an-llm-efficiency-security-kernel-and-deleted-my-own-best-idea.txt", "jsonld": "https://wpnews.pro/news/i-shipped-an-llm-efficiency-security-kernel-and-deleted-my-own-best-idea.jsonld"}}