Researchers at the Chinese tech giant have been analysing how fast AI agents can improve by performing real-world tasks
scaling lawgoverning how fast artificial intelligence agents can improve by performing real-world tasks, a finding that could help prolong the AI boom just as traditional development methods hit a wall.
In a research paper published on Thursday, ByteDance’s Seed AI team revealed that AI agents – autonomous software that executes tasks on a human’s behalf – can double their learning speed every three months by interacting with real-world environments over extended periods.
The finding comes as the global AI industry searches for new ways to improve models. For years, developers relied on feeding systems more data and computing power during initial training, but prominent industry figures – including OpenAI co-founder Andrej Karpathy – have warned that this brute-force approach cannot last forever.
a looming data drought. US-based research institute Epoch AI recently warned that publicly available, human-generated text data could be depleted within the next six years. That makes finding alternative paths to advance AI one of the industry’s highest priorities.
However, despite the fact that tech firms are pivoting towards agentic AI, ByteDance researchers noted in the paper that how these autonomous systems “learn from real-world environments after deployment remains far less understood”.
To address the problem, the team developed EdgeBench, a benchmarking suite featuring 134 ultra-long-horizon tasks spanning a wide range of areas from software engineering and scientific discovery to formal mathematics and professional knowledge work. Each task requires at least 12 hours of continuous AI agent operation.