arXiv:2611.23476v1 Announce Type: new Abstract: Autonomous AI agents pair a frozen base model with an editable harness of prompts, skills, tool rules, and memory. Recursive self-improvement (RSI) adapts this harness from experience without weight updates, yet self-editing without external graders often backfires: reflection and scalar scores conflate what an edit newly broke with what remains unsolved, causing local regressions, skill forgetting, and memory bloat. We introduce GUARD (Grader-free Unsupervised Environment Design [UED] with Adaptive Rule Distillation), a closed-loop framework for reference-free continual harness evolution. Our key insight is to decompose each task into pre-execution self-checks and guide harness updates via directional regret. Each round grades trajectories against these checks, pinning mastered rules while prioritizing newly broken behaviors, and selects among parallel candidate edits by critic-free group-relative fitness. A Soft-HURT gate then promotes an edit only when gains outweigh regressions, scoping specialized fixes to prevent over-triggering and guaranteeing non-regression on its gated buffer. At test time, one frozen harness runs in a single pass. Across benchmarks on memory, skill evolution, continual task streams, and domain reasoning, GUARD consistently improves performance without catastrophic forgetting or memory pollution while substantially cutting deployment token usage.
GUARD: Stabilizing Recursive Self-Improvement with Regret Guidance
A new arXiv paper (2611.23476v1) introduces GUARD (Grader-free Unsupervised Environment Design with Adaptive Rule Distillation), a closed-loop framework that stabilizes recursive self-improvement in autonomous AI agents by decomposing each task into pre-execution self-checks and guiding harness updates via directional regret. GUARD grades trajectories against those checks each round, pins mastered rules while prioritizing newly broken behaviors, and selects among parallel candidate edits using critic-free group-relative fitness, with a Soft-HURT gate that promotes an edit only when gains outweigh regressions and guarantees non-regression on its gated buffer. Across benchmarks on memory, skill evolution, continual task streams, and domain reasoning, GUARD improved performance without catastrophic forgetting or memory pollution while substantially cutting deployment token usage.
Gate each self-edit to an agent's harness on a non-regression buffer and promote it only when measured gains outweigh regressions, so recursive self-improvement avoids skill forgetting and memory bloat.
more in playbook: Designing agent systemsRun your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.