{"slug": "rl-environments-are-all-you-need", "title": "RL Environments are all you need", "summary": "RL environments are the essential data for training AI agents, according to a recent perspective shared by an industry commentator. The author argues that just as curated datasets enabled deep learning, RL environments enable agent development, allowing compute to update the LLM, system prompt, or harness. This approach is seen as the next step beyond traditional supervised learning, with tools like GEPA and AutoResearch already using environments to optimize prompts.", "body_md": "Recently I tweeted RL Environments are you need for RSI.\n\nIn fact, I wanted to share my perspective today that RL environments are all you need, which holds beyond RSI. RL environments are all you need when you build agents!\n\nWhat we learned from Deep Learning\n\nRemember the 60s and the 70s? I guess not, but anyhow, people at the time thought AGI is around the corner. They were building expert systems which were hand crafted if/else kind of heuristics and rules. Eliza was an expert-system chat bot built in 1966, and people thought it was great, until they figured it doesn't work, at all. The whole field collapsed and we went into AI winter.\n\nThen neural networks happened. It invented a systematic way of solving problems. Rather than hand crafting heuristics, the model learns to approximate the distribution of what you are trying to learn. You have to curate data and use compute to train the model.\n\nThe models got better with scale. This got us deep learning, but also a good understanding of the importance of scaling compute. The bitter lesson is by now very well understood.\n\nAnyway, the community converged on to a recipe: we curated data, split it into train and test, and trained a model on the train set and tested if it generalizes on the test set. This we learned in the school and we applied well at work. Legions of ML engineers used this recipe to transform the world.\n\nBut the equivalent thing for agents is missing. What we need is to figure out how to leverage compute to build agents.\n\nSo key questions:\n\nWhat's the data for agents?\n\nWhat constitutes an agent and how to leverage compute?\n\nAgent Data: RL Environments\n\nThe equivalent thing to data for agents is RL environments. We are expanding from from models that know things to agents that can do things.. in an environment. The agents are trained in these environments, and so that is now the new data.\n\nThe term \"RL\" in \"RL Environment\" is superfluous: it's just that people were using these environments for RL, but it's not necessary that RL needs to be used.\n\nWhat constitutes an agent?\n\nAgent is essentially a LLM put in a harness along with a system prompt.\n\nAny of these can be tuned/updated. For example, the frontier labs heavily invest into updating the LLMs, while the rest of the population is mostly focused on updating the prompts. Harness engineering is now picking up.\n\nGoing back, let's see how we can leverage compute to update these components.\n\nLeveraging compute to update the LLM\n\nThis one is obvious. You can use RL to update the LLM's weights. Or SFT or even midtrain with the trajectories generated from the environment. This is what the labs use, and there are a number of success stories now outside the lab as well where people are able to train LLMs to customize for their agentic use cases.\n\nThis is a clear use of leveraging compute to update the LLM parameters. And you need RL Environments for that!\n\nLeveraging compute to update the system prompt\n\nMost people have been writing prompts themselves but this doesn't work well for complex agents. Instead we are going to drift towards systems which use tools like GEPA or autoresearch to find the best system prompt that works for you.\n\nUltimately you and me are worse than powerful LLMs that can inspect, reflect, and write the system prompts. This is just the bitter lesson surfacing again.\n\nFor GEPA or autoresearch or evolutionary algorithms, you need to systematically have a way to get the score of how well a prompt is doing, and curate train/test splits (you want to iterate on the the train split, and see if you generalize on the test split).\n\nSo ultimately this is achieved by having good RL environments!\n\nLeveraging compute to update the harness\n\nThis is a bit of a new field!\n\nPeople are iterating on harness manually, but like everything else, I believe, we will have mechanisms to automate building of harness (it's essentially a piece of software).\n\nThe closest paper I know of is Meta-Harness work.\n\nWe are going to see a lot more work come out next year perhaps! At any rate, the best way to iterate over the harnesses is to have a set of RL environments for your use case.\n\nRL Environments are all you need for Evals\n\nBeyond training the agents, you can use RL environments to do systematic evals (rather than the vibe evals that people do now).\n\nFor example Snowflake CEO compared GLM-5.2 with Opus 4.7 and he did that by having access to 103 RL environments for dbt (guess who curated this data?).\n\nRL Environments are all you need!\n\nGist of what I have said:\n\nML recipe means you curate data, and leverage compute to train a model on the data.\n\nThe new agent recipe is to curate RL environments, and leverage compute to do one or more of: (1) updating the weights, (2) updating the system prompt, and (3) updating the harness.\n\nEven if you are not doing any of these, you should at least use them to do evals.\n\nAnd so RL environments are critical for building agents, and you are probably not investing enough into curating them.\n\nThis is why @bespokelabsai is razor focused on doing research and shipping RL environments. Whether you are a lab or an enterprise building/evaluating agents, RL environments are all you need.\n\nNext time, I will talk about what RL envs mean for software and for RSI.", "url": "https://wpnews.pro/news/rl-environments-are-all-you-need", "canonical_source": "https://twitter.com/madiator/status/2084657077637746957", "published_at": "2026-08-26 03:01:55+00:00", "updated_at": "2026-08-26 03:14:00.737281+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "ai-agents", "ai-research"], "entities": ["GEPA", "AutoResearch", "Meta-Harness", "Eliza"], "alternates": {"html": "https://wpnews.pro/news/rl-environments-are-all-you-need", "markdown": "https://wpnews.pro/news/rl-environments-are-all-you-need.md", "text": "https://wpnews.pro/news/rl-environments-are-all-you-need.txt", "jsonld": "https://wpnews.pro/news/rl-environments-are-all-you-need.jsonld"}}