# Atom Zero: a 49M local assistant that says "I don't know"

> Source: <https://dev.to/mycute_97b39c4e34027570f9/atom-zero-a-49m-local-assistant-that-says-i-dont-know-1p7m>
> Published: 2026-11-21 22:33:10+00:00

**Recommendation:** Route questions with no local source into a pending, human-approved curiosity queue that stores teacher output as unverified RAG notes, and gate all weight updates behind reviewed feedback and explicit rollback.
More in the playbook "Designing agent systems": <https://wpnews.pro/playbooks/agent-architecture>

Most local AI demos start with a bigger model. I went the other way: a **49.2M parameter model trained from scratch**, wrapped in a runtime that does the things a small model is bad at — retrieval, tools and honest missing-source handling.

A 49M model is not a general assistant. On a no-RAG knowledge probe it scores **2/10**. It will not write your backend or answer MMLU. Pretending otherwise is how tiny-model demos lose trust.

So Atom Zero separates responsibilities:

| check | result | 
|---|---|
| raw 49.2M, no RAG/tools | 2/10 | 
| product with RAG/tools | 21/21 | 
| behavior checks | 16/16 | 
| source-cited retrieval top-1 | 1.000 (FTS 0.850) | 
| tests | 392 passed | 

The 21/21 is the **product**, not the bare model. The benchmark is narrow and authored: tools, memory, retrieval, missing-source behavior and one short generation. It is not MMLU, GSM8K or HumanEval.

The loop is deliberately boring:

``` php
question -> no local source -> knowledge gap
gap -> pending curiosity topic
human approves
worker fetches Wikipedia context, local Ollama teacher synthesizes
answer stored as an **unverified teacher note** in RAG
next answer can cite it; weights_changed: false
```

A live run produced `unapproved_run: 0`, then `approved_run: done`, then a cited answer. The model did not decide what to study and did not mutate its own weights. Weight updates happen only through reviewed feedback -> gated LoRA -> explicit activation/rollback.

```
pip install streamft==0.8.0
git clone https://github.com/byjameson/stream-finetune.git
cd stream-finetune
powershell -ExecutionPolicy Bypass -File scripts/quickstart_atomzero.ps1
```

Try these:

``` php
What is the launch code?                         -> cited local answer
What is the population of Paris?                 -> no source; gap recorded
Propose curiosity topics                         -> pending, approval required
Add task buy milk / My name is Alex              -> local tools + memory
```

Optional stronger local chat:

```
powershell -ExecutionPolicy Bypass -File scripts/quickstart_atomzero.ps1 -WithProvider
```

If you run local models on a small GPU, want source-cited notes, or are building a compact RAG/agent reference, I would like to hear what breaks first.

Apache-2.0 for code and weights. Built on a 6 GB RTX 3050 laptop.
