{"slug": "self-improvement-memory-googles-crsi-harness-optimization-paper", "title": "Self-Improvement Memory: Google’s CRSI Harness Optimization Paper", "summary": "Google researchers proposed Self-Improvement Memory (SIM) in arXiv paper 2611.18856, \"Self-Improvement Memory Enables Continual Recursive Self-Improvement,\" to let agents keep improving their harness — prompts, tools and context rules — without losing the rationale behind earlier edits when the benchmark or model changes. The paper defines Continual Recursive Self-Improvement (CRSI) and reports that full SIM beats harness-only and root-cause-only continuation, with a mean gain of +2.36 points over harness-only across 10 paired coding runs (p=0.003). The authors document harness transfer brittleness, noting an Opus-evolved harness started below the seed harness on Gemini in their workspace experiment (68.41 vs 73.89).", "body_md": "**Google researchers proposed Self-Improvement Memory (SIM)** so agents can keep improving their **harness**—prompts, tools, context rules—without forgetting why earlier edits worked when the benchmark or model changes. The paper [*Self-Improvement Memory Enables Continual Recursive Self-Improvement*](https://arxiv.org/abs/2611.18856?ref=explainx) (arXiv **2611.18856**) defines **Continual Recursive Self-Improvement (CRSI)** and reports consistent gains over continuing optimization with the harness alone.\n\nFor builders, the headline is practical: **harness transfer is brittle**. An Opus-evolved harness can start **below** the seed harness on Gemini in the authors’ workspace experiment (68.41 vs 73.89 in their figure). SIM is meant to supply the missing **rationale and outcomes** so the optimizer knows what to keep, revise, or delete.\n\n## TL;DR\n\n| Piece | What the paper says | \n|---|---|\n| Object optimized | Executable harness around a **fixed** policy model | \n| SIM stores | Problem groups, edit rationale, predicted vs observed scores, context | \n| CRSI settings | Cross-dataset (same model) and cross-model (same benchmark split) | \n| Main result | Full SIM beats harness-only and root-cause-only continuation | \n| Coding delta | Mean **+2.36** points vs harness-only on 10 paired runs (p=0.003) | \n| Code release | Not linked on arXiv page when we checked | \n\n## Why harness-only transfer fails\n\nModern agents depend on **two** artifacts: weights inside the policy model and the **harness** that manages context, tools, and execution. Manual harness tuning is slow; recent **recursive self-improvement (RSI)** work automates propose-evaluate-select loops ([Meta-Harness](https://arxiv.org/abs/2503.18878?ref=explainx) lineage cited in the paper).\n\nThe authors argue RSI usually assumes a **fixed** model and benchmark. Real teams break that assumption constantly:\n\n| Transition | What breaks | \n|---|---|\n| New model version | Mechanisms tuned for Opus interact differently on Gemini | \n| New task suite | A completion gate that checked command success may need optimality checks | \n\nWithout memory, the target optimizer sees **code diffs** but not **why** a gate existed or what failure it fixed—so it may repeat failed edits or strip useful guards.\n\nProduct teams feel the same pain when they copy a `CLAUDE.md` from an Opus project to a Gemini project and watch pass rates crater. Benchmark leaders publish **harness recipes**—see the [higher-scoring models vs merge-rate experiment](https://explainx.ai/blog/higher-scoring-coding-models-swe-bench-merge-rate-natural-experiment-2026)—but those recipes are rarely portable without the **failure logs** that produced them. SIM is the paper’s proposal for machine-readable failure logs at harness-edit granularity.\n\n## What SIM records\n\nSIM groups edits by **recurring harness problems** and logs:\n\n- Rationale for the proposed change\n- Predicted and observed outcomes after evaluation\n- Evaluation context on the evolve set\n\nBoth the **proposer** and **selector** read SIM each round. New attempts **append** to existing problem entries instead of resetting history.\n\nThat differs from storing only candidate harnesses (HarnessBank-style grouping) or free-text notes: SIM ties **problems → modifications → measured results** in one structure the LLM harness engineer can query.\n\nStructured notebook beside an agent node, illustrating harness edit history the optimizer can query\n\n## CRSI problem setup\n\nThe paper formalizes harness RSI with rounds of propose, screen, execute, and select (Equation 1 in the PDF). **CRSI** resumes from the source harness after optimization in the source setting and continues in a target setting.\n\n| Mode | Change | Fixed | \n|---|---|---|\n| Cross-dataset CRSI | Benchmark task suite | Policy model | \n| Cross-model CRSI | Policy model | Benchmark split | \n\nTarget improvement is final minus starting score on held-out evaluation—standard harness optimization hygiene with evolve vs eval splits.\n\nTest bench framing for evolve versus held-out harness evaluation splits\n\n## Experimental claims to read carefully\n\nThe abstract highlights four domains and six cross-dataset plus four Opus→Gemini comparisons where **Full SIM** tops ablations without memory or with root causes only.\n\nThe coding headline is statistical: across **ten independent source runs**, paired continuations with SIM improve **9 of 10** runs, **mean +2.36 points** over harness-only continuation, **p=0.003**.\n\nThose numbers are **authors’ benchmarks**, not a guarantee on your repository. They do support the intuition that **memory of the improvement process** matters—not only the final harness artifact.\n\nConnect this to industry narratives without overclaiming:\n\n- [Together’s compiler-agent RSI for inference](https://explainx.ai/blog/together-compiler-agents-optimize-inference-1111-tps-minimax-1205-tps-deepseek-claimed-vs-verified-2026) optimizes**engine code** , not harness prompts—different loop, same vocabulary.\n- [Anthropic’s RSP threshold updates](https://explainx.ai/blog/anthropic-rsp-ai-rd-threshold-met-s-1-amendment-2-november-2026) discuss**model** acceleration, while SIM is**harness** acceleration.\n- [MIT weight-space programming](https://explainx.ai/blog/weight-space-programming-gpt-6-astra-edits-qwen3-5-0-8b-weights-math-7-9-to-48-1-mit-csail-2026) edits weights; SIM explicitly keeps weights fixed.\n\n## Meta-Harness lineage and what SIM adds\n\nThe related-work section places SIM beside **Meta-Harness**, **AHE**, and **HarnessBank**-style memory. Those systems already store **candidates** or **edit graphs**. SIM’s twist is to keep **problem labels** stable across CRSI: when the benchmark shifts from “did the shell command run?” to “is the solution optimal?”, the optimizer can query SIM for the **original bug class** instead of guessing from the final Python file alone.\n\nFor readers who track **agent evals**, that is closer to maintaining a **regression suite for harness code** than maintaining prompts. If your team runs [SWE-CoWork-style benches](https://explainx.ai/blog/swe-cowork-coding-agents-digital-employees-benchmark-2026), imagine each flaky harness gate becoming a SIM entry with pass/fail history whenever you promote a new base model.\n\n## Interpreting the Opus→Gemini regression example\n\nThe paper’s workspace figure is a cautionary tale: an evolved harness that scored well under Anthropic’s policy model can **underperform the seed harness** on Gemini despite identical tasks. That is not a surprise to anyone who has swapped models on a brittle tool-calling loop, but it is useful evidence because it is **quantified** rather than anecdotal.\n\nBuilders should replicate a miniature version before production promotion:\n\n1. Freeze your evolve split and held-out split.\n2. Run harness RSI once on model A.\n3. Resume CRSI on model B with harness-only vs SIM-enabled optimizers.\n4. Compare held-out scores, not evolve-set peaks.\n\nIf you lack Google’s automations, you can still **manually** append a JSONL file of `{problem, edit, outcome}` beside your harness repo—SIM’s idea without the full selector stack.\n\nLightweight scaffold holding a harness module while the policy model stays fixed\n\n## Safety and misuse angles\n\nMemory of successful hacks is double-edged. A harness edit that **overfits** the evolve set (for example, hard-coding test identifiers) will look brilliant in SIM until held-out evaluation collapses. The paper leans on standard evolve vs eval splits, but product teams should add **red-team tasks** the evolve set never sees—similar to [Vals.ai military targeting critiques](https://explainx.ai/blog/vals-ai-military-targeting-civilians-game-framing-claude-opus-5-5-2026) about eval framing.\n\nStoring rationale also creates **data-retention** questions: SIM logs may include stack traces, API errors, or user data snippets from evolve tasks. Any future open-source drop will need scrubbing policies like those discussed in [enterprise agent memory posts](https://explainx.ai/blog/raindrop-reasoning-agent-memory-tau2-bench-67-percent-2026).\n\n## How this relates to harness tooling you can use today\n\nUntil SIM ships in a product, builders still improve harnesses manually or via open tools:\n\n| Approach | Memory of edits? | \n|---|---|\n| Git history on `CLAUDE.md` / skills | Diffs only | \n| [SoduWork plugins](https://explainx.ai/blog/soduwork-self-hosted-multi-harness-agent-workspace-2026) | Versioned workflows with review | \n| [LoopForge SOPs](https://explainx.ai/blog/tencent-loopforge-self-hosted-sop-coding-agents-claude-codex-2026) | Human gates, not automatic harness search | \n\nSIM is the research direction that could eventually sit **under** those control planes if Google productizes CRSI.\n\n## Authors and affiliations\n\nThe PDF lists **Google Cloud AI** and **Google DeepMind** authors alongside **Penn State** (Lingzhou Xue). Footnotes note Xin Yu interned at Google. That placement matters for credibility and for where a future open release might appear—similar to other [Google GTIG security research](https://explainx.ai/blog/google-gtig-sombermeme-claude-code-settings-backdoor-november-2026) paths.\n\n## What to watch next\n\n1. **Code or HarnessBank integration** — if authors release SIM logs, try replaying CRSI on your own benchmark split before swapping models in production.\n2. **Cross-model tables** — reproduce the Opus→Gemini regression on an internal task before trusting a transferred harness from a vendor eval.\n3. **Safety** — richer harness memory can also preserve**unsafe shortcuts** that scored well on evolve sets; keep held-out eval and human review ([Raindrop-style agent memory](https://explainx.ai/blog/raindrop-reasoning-agent-memory-tau2-bench-67-percent-2026) discusses related RSI risks).\n\n## FAQ tie-in: is this “real” recursive self-improvement?\n\nReaders often conflate **harness RSI** with **weight RSI**. This paper keeps the policy checkpoint fixed while an outer loop edits orchestration code. That matches [Together’s compiler-agent loop](https://explainx.ai/blog/together-compiler-agents-optimize-inference-1111-tps-minimax-1205-tps-deepseek-claimed-vs-verified-2026) more than [weight-space programming](https://explainx.ai/blog/weight-space-programming-gpt-6-astra-edits-qwen3-5-0-8b-weights-math-7-9-to-48-1-mit-csail-2026). When vendors say “self-improving,” ask whether tokens, harness files, or weights changed.\n\n## Workshop tie-in for practitioners\n\nTeams running [Claude Code workshops](https://explainx.ai/blog/top-claude-live-workshops-2026) already document why each harness tweak worked. SIM formalizes that habit for automated selectors. The homework after reading the paper: start a **harness changelog** with measured outcomes before your next model upgrade.\n\n## Implementation checklist (manual SIM today)\n\nYou can approximate SIM without Google’s stack:\n\n| Step | Action | \n|---|---|\n| 1 | Tag each harness edit with a **problem id** (tool timeouts, wrong file paths, format drift) | \n| 2 | Log **predicted fix** and**observed metric** on evolve and held-out splits | \n| 3 | When swapping models, feed the log to the human reviewer before accepting inherited gates | \n| 4 | Archive rejected edits so the optimizer does not re-propose them | \n\nThis mirrors how [ForceHarness](https://explainx.ai/blog/forceharness-frozen-frontier-models-force-robot-harness-2026) keeps robot policies stable while models churn—different domain, same portability problem.\n\nPaper authors also cite **continual learning** concerns—catastrophic forgetting when new edits erase old fixes. SIM’s grouped problem entries are their mitigation: append new attempts under the same problem id instead of wiping history. That design choice is why the selector can reject a flashy harness rewrite that violates an earlier constraint logged under the same heading.\n\nIf Google releases code, expect it beside **Cloud AI** agent tooling rather than as a consumer feature. Until then, treat arXiv 2611.18856 as the authoritative description of CRSI and SIM behavior, and reproduce key tables yourself before changing production harnesses.\n\n## Related reading\n\n*Claims follow [arXiv:2611.18856](https://arxiv.org/abs/2611.18856?ref=explainx) as published November 2026.*", "url": "https://wpnews.pro/news/self-improvement-memory-googles-crsi-harness-optimization-paper", "canonical_source": "https://explainx.ai/blog/google-self-improvement-memory-crsi-harness-optimization-2026?utm_source=rss&utm_medium=feed&utm_campaign=blog", "published_at": "2026-11-18 00:00:00+00:00", "updated_at": "2026-11-18 12:15:17.564564+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-agents", "ai-research", "large-language-models"], "entities": ["Google", "Self-Improvement Memory", "Continual Recursive Self-Improvement", "arXiv", "Meta-Harness", "Opus", "Gemini"], "also_reported_by": [], "takeaway": "Storing edit rationale plus predicted and observed scores in a queryable memory (SIM) lifted coding scores a mean +2.36 points over harness-only continuation across 10 paired runs (p=0.003), versus an Opus-evolved harness that scored 68.41 on Gemini against a 73.89 seed.", "recommendation": {"advice": "Log each harness edit's rationale, predicted vs observed score and evaluation context, and append to existing problem entries rather than resetting, so the optimizer can keep, revise or delete edits when the model or benchmark changes.", "playbook": "agent-architecture", "playbook_url": "https://wpnews.pro/playbooks/agent-architecture"}, "alternates": {"html": "https://wpnews.pro/news/self-improvement-memory-googles-crsi-harness-optimization-paper", "markdown": "https://wpnews.pro/news/self-improvement-memory-googles-crsi-harness-optimization-paper.md", "text": "https://wpnews.pro/news/self-improvement-memory-googles-crsi-harness-optimization-paper.txt", "jsonld": "https://wpnews.pro/news/self-improvement-memory-googles-crsi-harness-optimization-paper.jsonld"}}