Photo: Merlin Lightpainting / Pexels
A persistent wiki-style knowledge base lets AI agents actually remember what they've learned, boosting scores by double digits
Google Research has introduced WikiSkill, a framework that gives AI agents the ability to learn from experience and retain that knowledge across iterations. The method uses a persistent wiki-style knowledge base to track skill improvements, and the results across five benchmarks suggest it works remarkably well.
The core problem WikiSkill addresses is that previous skill-evolution methods for AI agents would generate useful insights during execution, then discard them after each cycle rather than carrying them forward.
How WikiSkill actually works #
The framework is built on a three-layer architecture, each serving a distinct purpose. The Raw Layer captures immutable execution traces, essentially a complete record of everything the agent did and what happened. The Wiki Layer consolidates that raw data into accumulated knowledge. And the Skill Layer hosts the executable procedures the agent can actually deploy.
Four key components keep the system running. An inference agent handles task execution. A wiki maintainer updates the knowledge base as new information comes in. A skill proposer generates candidate procedures based on accumulated knowledge. And a validation gating mechanism acts as quality control, ensuring only genuinely useful skills make the cut.
The numbers across five benchmarks #
WikiSkill was validated across five benchmarks designed to test fundamentally different capabilities: math reasoning, web search, spreadsheet management, long-context question answering, and embodied interaction.
The standout results came from Gemini-3.5-Flash. On LiveMathematicianBench, performance jumped from 33.0% to 72.6%. On SpreadSheetBench, scores climbed from 50.5% to 76.6%. Across all benchmarks, the average gain was 12.0 points.
Ablation studies confirmed that the persistent wiki is the critical component driving performance gains. Remove it, and the improvements largely disappear.
Skills learned by one model were shown to outperform self-evolved skills when applied to a different model entirely, including models from different families.
The research was authored by Liyan Tang, Cyrus Rashtchian, Chun-Sung Ferng, Andrew Tomkins, Da-Cheng Juan from Google Research, and Tu Vu from Google Research and Virginia Tech.
Disclosure: This article was edited by Editorial Team. For more information on how we create and review content, see our