Google researchers find a way to keep self-improving AI agents from memorizing their tests

Google researchers developed RRSI, a method that prevents self-improving AI agents from memorizing their test tasks, lifting scores on unseen benchmarks by up to 4.7 points while using about 30 percent fewer tokens than an unregularized version. The technique addresses the tendency of self-improving agents to overfit to evaluation tasks, causing gains to shrink or disappear on new ones.

Self-improving AI agents tend to memorize their test tasks, so their gains shrink or disappear on new ones. RRSI, a new method from Google researchers, reins in this effect and lifts scores on unseen benchmarks by up to 4.7 points while using about 30 percent fewer tokens than an unregularized version. The article Google researchers find a way to keep self-improving AI agents from memorizing their tests https://the-decoder.com/google-researchers-find-a-way-to-keep-self-improving-ai-agents-from-memorizing-their-tests/ appeared first on The Decoder https://the-decoder.com .