{"slug": "most-important-paper-ai-can-read-write-weights", "title": "Most Important Paper: AI Can Read & Write Weights", "summary": "Researchers at MIT CSAIL used GPT-6 Astra to directly edit the weights of the open-source Qwen3.5-0.8B model, changing only 0.016% of them and raising mathematical accuracy from 7.9% to 48.1% under the team's test configuration, according to a research project that went viral on X on November 2. The gain came primarily from fixing a failure mode in which the model repeatedly got stuck in its reasoning process and never produced an answer, unlocking capabilities the model already had rather than teaching it math from scratch. The MIT team has not yet shown whether the direct weight-editing approach is cheaper overall than fine-tuning or additional training.", "body_md": "As everyone knows, training a model is an extremely expensive and time-consuming process, even if you only do post-training and not pre-training.\n\nPlease improve an AI that is bad at math without any additional training\n\nWhen given this task, we would normally think about adding more training data, fine-tuning, reinforcement learning, or improving its reasoning process at inference time.\n\nHowever, a new research project has explored a completely different approach.\n\nThe idea is to let an LLM examine the internal structure of another neural network, figure out which weights need to be changed and how to change them, and then directly modify those weights.\n\nAn article went viral on X on November 2, mentioning that researchers at MIT CSAIL had GPT-6 Astra drastically modify the weights of the Qwen3.5–0.8B algorithm. The changes were minimal, only 0.016%.\n\nBut the result shocked everyone: under the research team’s test configuration, the mathematical accuracy rate rose from 7.9% to 48.1%.\n\nHowever, it would be too early to conclude that the AI has learned mathematical skills from scratch.\n\nThe main achievement here is that the researchers fixed a problem where the model repeatedly got stuck in its reasoning process and failed to produce an answer. By fixing this issue, they were able to unlock capabilities the model already had but couldn’t properly demonstrate.\n\nEven on its own, this is a pretty interesting result.\n\nIf you like this topic and you want to support me:\n\nFirst, let’s talk about “weights” inside a model. They are a large collection of numbers that the model uses when processing input.\n\nChanging these numbers changes how the model produces its outputs.\n\nDuring pre-training, the model is fed massive amounts of data, such as text. It makes predictions and compares them with the expected results.\n\nThe training algorithm then calculates how the weights should be adjusted based on the errors and repeatedly updates them.\n\nThis entire process requires collecting and cleaning huge amounts of data, as well as significant computing resources.\n\nAfter a model is trained, it usually goes through another stage called post-training to make it better at following instructions and handling specific tasks. One common method is supervised fine-tuning using examples.\n\nDifferent methods use different data and training objectives, but they often still require repeatedly processing data, updating parameters, and evaluating the results.\n\nThe challenge is that you might only want to fix one specific problem, but you may not know which numbers inside the model are responsible for it.\n\nFurther training can change the model’s behavior, but preparing data, running experiments, and evaluating the results all come with costs. Even after fixing one problem, you still need to check whether other capabilities have been affected.\n\nSo, what if we could identify the source of the problem and directly modify the relevant weights?\n\nThat’s the approach the MIT team decided to explore. However, their experiments have not yet demonstrated whether this approach is actually cheaper overall.\n\nIn this research, the team conducted an experiment using a state-of-the-art large AI model (GPT-6 Astra) to directly modify the internal parameters of a lightweight, open-source AI model (Qwen).\n\nInside an AI model, there are enormous collections of numbers called weights (parameters). You can think of them as similar to the strength of connections between neurons in the human brain.\n\nThey essentially form the model’s internal structure, influencing how it processes information and generates outputs.\n\nIn traditional AI development, improving a model’s performance or making it better at a specific task usually involves techniques such as fine-tuning or additional training.\n\nThis means repeatedly feeding the AI large numbers of questions and answers (training data) and spending significant computing time gradually optimising its internal parameters.\n\nHowever, the approach used in this research is different. No additional training was performed.\n\nInstead, an advanced AI model directly examined the target model’s internal weights, analyzed where potential problems or bottlenecks were located, and then selectively rewrote specific values.\n\nTo put it simply, imagine a human patient. Instead of making them solve thousands of problems to improve their abilities, a skilled surgeon examines their brain’s neural connections and fixes a few specific problems directly.\n\nAccording to the report, only about 0.016% of the model’s total weights were modified.\n\nDespite such a small change, the results showed a dramatic improvement, with the math benchmark score increasing from 7.9% to 48.1%.\n\nRather than teaching the model entirely new knowledge from scratch, the researchers appear to have fixed an internal structural problem that caused the model to get stuck in reasoning loops and fail to produce answers.\n\nAlthough this research is a major technical achievement, it also raises some serious concerns.\n\nMy biggest concern is that the performance gap between state-of-the-art commercial AI models and open-source models that anyone can modify could shrink much faster than before.\n\nLeading AI models from companies like OpenAI and Anthropic have strict safety standards and guardrails designed to prevent them from generating harmful information.\n\nOn the other hand, open-source models can run locally and offer users much more freedom to use and modify them.\n\nUntil now, bringing an open-source model up to the level of the most advanced AI systems has required enormous resources.\n\nThis created a certain barrier that made it difficult for individuals or organisations to independently develop and maintain highly capable models.\n\nHowever, if advanced AI models can directly identify and fix the weaknesses of open-source models, we might eventually see powerful AI systems being developed in less time and at a lower cost, potentially without the same safety restrictions.\n\nAnother concern is that directly modifying a model’s internal weights can be used for both good and bad purposes.\n\nWhen used responsibly, this technology could improve safety and fix existing problems. But in the wrong hands, it could also be used to completely disable the safety mechanisms built into a model.\n\nThis research introduces a new possibility for improving AI models.\n\nIn the future, instead of spending huge amounts of computing power on retraining or post-training every time we want to improve a model, we might be able to use another AI to identify which weights need adjustment and modify them directly.\n\nIf this approach works at scale, developers could use it to fix problems in existing models. Going one step further, could we also directly add new capabilities by modifying the weights? That’s another direction the research team wants to explore.\n\nHowever, this experiment focused on fixing an existing problem. Astra did not perform gradient-based training. Instead, it helped Qwen overcome repetitive reasoning loops.\n\nIdentifying problems and testing the results still require data and computing resources. Whether this approach is actually more cost-effective has not yet been directly demonstrated.\n\nThe research team also mentioned RSI (Recursive Self-Improvement). The idea is that if a model can eventually examine and modify its own weights, then use its improved capabilities to continue optimising itself, AI could gain an entirely new path toward self-improvement.\n\nIn this experiment, Astra modified Qwen. The idea of an AI modifying itself and becoming more powerful through repeated cycles is still a vision for the future.\n\nReference :\n\n[Most Important Paper: AI Can Read & Write Weights](https://pub.towardsai.net/most-important-paper-ai-can-read-write-weights-9d6f30eaa1ca) was originally published in [Towards AI](https://pub.towardsai.net) on Medium, where people are continuing the conversation by highlighting and responding to this story.", "url": "https://wpnews.pro/news/most-important-paper-ai-can-read-write-weights", "canonical_source": "https://pub.towardsai.net/most-important-paper-ai-can-read-write-weights-9d6f30eaa1ca?source=rss----98111c9905da---4", "published_at": "2026-11-11 12:31:02+00:00", "updated_at": "2026-11-11 12:51:59.796477+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "large-language-models", "ai-research"], "entities": ["MIT CSAIL", "GPT-6 Astra", "Qwen3.5-0.8B", "Qwen", "X"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/most-important-paper-ai-can-read-write-weights", "markdown": "https://wpnews.pro/news/most-important-paper-ai-can-read-write-weights.md", "text": "https://wpnews.pro/news/most-important-paper-ai-can-read-write-weights.txt", "jsonld": "https://wpnews.pro/news/most-important-paper-ai-can-read-write-weights.jsonld"}}