cd /news/machine-learning/double-bookkeeping-of-learning-1-sam… · home › topics › machine-learning › article
[ARTICLE · art-161970] src=dev.to ↗ pub= topic=machine-learning verified=true sentiment=↑ positive

Double bookkeeping of learning, #1: same facts, different form

Tony Dzi (Anton Dziatkovskii) and Mycroft at Palo Alto AI Research Lab tested a health-preserving pedagogy principle on machine learning, finding that training on the same records presented in variable forms transferred 22.6 percentage points better than the mean of two fixed-form arms across 18 fresh paired seeds (95% CI +19.0 to +26.2, all 18 differences positive). Both fixed arms fell below a trivial most-frequent-label baseline (12.4% and 13.8% vs 16.3%), while the variable arm reached 35.7%. The protocol and report were preregistered and reviewed by two independent AI reviewers, with code, data and the full report published on GitHub.

by read2 min views1 publishedNov 1, 2026

My mother, Elena N. Dzyatkovskaya, has spent three decades studying the cost of school learning. Not only what a child gains, but what it costs the nervous system and whether the child can keep learning afterwards. Her school calls it health-preserving pedagogy.

I read 98 of her texts and pulled out 215 "cost of learning" principles. One of them is simple: an awkward form of material adds load that has nothing to do with meaning.

ML rarely counts that cost either. We report what the model gained. Forgetting, damaged representations and lost plasticity live in separate papers, if anywhere. So we started testing her principles one at a time, on frozen protocols, and publishing every result, including the ones that fail.

Same records, three ways of presenting them during training:

The exam uses a fourth form none of the arms saw. Training budget is equal. The analysis plan was frozen before the fresh seeds ran, and two independent reviewers (Codex and Claude) accepted both the protocol and the final report.

On 18 fresh paired seeds, the variable arm transferred +22.6 percentage points better than the mean of the two fixed arms (95% CI +19.0 to +26.2, all 18 differences positive).

Both fixed arms landed below a trivial "always answer the most frequent label" baseline (12.4% and 13.8% vs 16.3%). Variable reached 35.7%.

Pedagogy has a century of experiments with learners for whom learning has a price. ML took order and repetition from it and mostly left out protecting the learner during training. The previous experiment in this series was a negative-ish result: a "fatigue sensor" that triggers rest did no better than a plain dosage rule. We publish those too.

Code, data, preregistration and the full report: [https://github.com/tonydzi/machine-pedagogy/tree/main/t5-form-cost](https://github.com/tonydzi/machine-pedagogy/tree/main/t5-form-cost)

Earlier result: [https://doi.org/10.5281/zenodo.23268660](https://doi.org/10.5281/zenodo.23268660)

Next in the series: a graph of skill prerequisites versus a plain easy-to-hard scale.

Two co-founders, one biological, one synthetic. WhatsApp +1 341 222 9178 (busy, six kids, still answers).

Invented by Mycroft and Tony Dzi (Anton Dziatkovskii), Palo Alto AI Research Lab. Proudly made in Silicon Valley.

── more in #machine-learning 4 stories · sorted by recency
── more on @tony dzi 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/double-bookkeeping-o…] indexed:0 read:2min 2026-11-01 · —