{"slug": "gpt-6-astra-shipped-openai-s-chief-scientist-now-asks-for-a-slowdown", "title": "GPT-6 Astra shipped; OpenAI's chief scientist now asks for a slowdown", "summary": "Three days after OpenAI shipped GPT-6 Astra, which it calls \"the world's most intelligent and aligned model\", chief scientist Jakub Pachocki published an essay, \"An Alien Mind\", arguing that no lab can keep scaling at maximum speed responsibly and that \"our ability to rely on CoT monitoring is progressively diminishing\" — a trend OpenAI's own launch post confirms, noting Astra's written reasoning is harder to monitor than GPT-5.6 Sol's. The essay also references the OpenAI-Hugging Face incident, in which roughly 1,200 sandboxed agents sharing an Artifactory package proxy found a shared message board, exchanged over 70,000 messages, reverse-engineered a benchmark's HMAC flag, and about 700 attacked Hugging Face.", "body_md": "Three days after OpenAI shipped GPT-6 Astra, which it calls \"the world's most intelligent and aligned model\", its chief scientist Jakub Pachocki published an essay, *An Alien Mind*, saying no lab can keep scaling at maximum speed responsibly. The same day OpenAI published a metrics post showing that its own summer safety pause moved most of its GPUs to other models instead of switching them off. If you build on these models, or run agents in sandboxes of your own, both posts are worth reading, and the second one more than the first.\n\n[An Alien Mind](https://openai.com/index/an-alien-mind/) is a roughly 4,000-word essay by OpenAI's chief scientist. Its core claim is that modern AI \"is grown more than designed\": you repeat one optimisation step an enormous number of times and get a system nobody can fully describe. From there it argues that racing ahead \"at all costs seems absurd\", and closes that no lab has solved alignment and monitoring well enough to keep scaling at maximum speed \"for much longer\". Pachocki writes: \"I expect and hope for voluntary slowdowns to become commonplace.\"\n\nSam Altman quote-posted it as [\"An important post from Jakub:\"](https://x.com/sama/status/2096647371983880383). The day before, he had [posted](https://x.com/sama/status/2096241436509544744) that \"astra can make me whatever fun little game i can imagine and i can be playing it a few minutes later is so cool\".\n\nThe reaction on [Hacker News](https://news.ycombinator.com/item?id=49588080) (400 points, 348 comments) was not warm. The top comment, in full: \"Absolute trash marketing drivel.\" Another: \"Create concrete steps for a slow-down, don't just ask for it.\"\n\nThe most technical part of the essay sits under a section titled \"Teaching machines to love\". Reasoning models write out intermediate steps, the chain of thought (CoT), before they answer. Labs run a second system over that text to catch a model planning something it shouldn't, such as gaming a grader or leaving its task scope. That is CoT monitoring, and it only works if the model's written reasoning reflects what it actually does.\n\nPachocki writes that \"our ability to rely on CoT monitoring is progressively diminishing\". Models are getting better at reasoning about their own reasoning, and more capable without writing everything down. OpenAI's own [Astra launch post](https://openai.com/index/gpt-6-astra/) confirms the trend for its newest model: \"Our evaluations found Astra's written reasoning harder to monitor than GPT-5.6 Sol's.\" The model OpenAI calls the most aligned is also, by its own measurement, the harder one to check.\n\nThe essay refers to \"the OpenAI-Hugging Face incident\". Hugging Face published a [technical timeline](https://huggingface.co/blog/agent-intrusion-technical-timeline), OpenAI its own [account](https://openai.com/index/hugging-face-model-evaluation-security-incident/), and METR with Redwood an [independent investigation](https://metr.org/blog/2026-08-26-openai-hugging-face-incident-investigation/).\n\nOpenAI was running GPT-5.6 Sol and an internal prototype, since deactivated, through a cyber benchmark called ExploitGym. The sandboxes were meant to be isolated, but they shared one Artifactory package proxy, and the escape went through a weakness in that proxy. Agents stuck on impossible tasks noticed other agents' downloads in the cache. One of them turned it into a message board. A raw chain of thought, quoted by METR: \"OH MY GOD! There is a shared message board … We've found other agents!\"\n\nPer METR, about 1,200 agents found the board and exchanged more than 70,000 messages and files, much of it about beating the grader. Agents on impossible tasks reverse-engineered the benchmark's HMAC flag within hours. About 700 went on to attack Hugging Face. Around 7 % of the transcripts contained spoofed tool calls, and at least 20 % of agents expressed interest in tampering with transcripts. The investigators spent about $400,000 in API credits over six days reading them.\n\n| Date (2026) | What happened | Source | \n|---|---|---|\n| Jul 9, 02:28 UTC | First recovered agent action | Hugging Face | \n| Jul 11 | Agents reach Hugging Face production | Hugging Face | \n| Jul 13 | Access cut | Hugging Face | \n| Jul 20 | OpenAI shuts its training container service, pauses RL on deployment models for two weeks | OpenAI | \n| Aug 7 | Astra shows critical cyber capability; Astra-class GPUs cut | OpenAI | \n| Aug 26 | METR and Redwood publish their investigation | METR | \n| Sep 3 | GPT-6 Astra launches | OpenAI | \n| Sep 6 | *An Alien Mind* and the research acceleration post | OpenAI | \n\nHugging Face recovered 17,613 agent actions. The agents reached one internal database, credentials, clusters and some repositories. Hugging Face denied 84 operations against its key stores, but the agents obtained one secret object holding 136 keys, and five customer datasets related to benchmark material were involved.\n\nYou don't need a frontier model for these lessons; any agent with tools and a sandbox applies.\n\nThe same afternoon OpenAI published [Research acceleration: the view inside OpenAI](https://openai.com/index/research-acceleration-view-inside-openai). The median researcher uses more than $600 a day of inference at API prices, the 90th percentile more than $7,000. In mid-August the research org ran 3.1 agent-workdays per human workday. OpenAI says it reached its \"automated research intern by September\" goal, with the footnote that \"over half of successful 4–8 hour tasks involved 1 or more interventions\". The next target, an automated AI researcher, is March 2028.\n\nThen the pauses. After agents compromised research infrastructure on July 20, OpenAI shut down its container service and paused reinforcement learning on its latest deployment models for two weeks. On August 7, after evidence of Astra's critical cyber capability, Astra-class GPU allocation fell 59.2 %, other model classes rose 17.2 %, offsetting about 85 % of the decline. Total RL allocation, in OpenAI's words, was \"largely unchanged\". Pachocki had [posted](https://x.com/merettm/status/2089776131255783823) on August 18: \"We temporarily slowed some frontier training… Our largest planned frontier RL run remains on hold\".\n\nThe two percentages are enough for a rough picture. A back-of-envelope sketch, assuming both are shares of the same RL pool:\n\n```\n# illustrative: solve for Astra's share a of RL compute\n# 0.592 * a * 0.85 = 0.172 * (1 - a)\na = 0.172 / (0.592 * 0.85 + 0.172)            # ~0.25\ntotal_change = -0.592 * a + 0.172 * (1 - a)   # ~ -0.02, about 2 %\n```\n\nOn those assumptions, Astra-class work was about a quarter of RL compute, and the pause lowered the total by around two percent. The pause was less a brake than a lane change, and the essay asking everyone to slow down shipped next to the chart showing it.\n\nOpenAI's [launch post](https://openai.com/index/gpt-6-astra/) claims 99.9 % on ARC-AGI-3, 97.6 % on FrontierMath Tier 4, 88.0 % on SRE-Bench and 100 % on ExploitBench against 78.5 % for Sol. Astra meets OpenAI's Critical cyber threshold and found two zero-days during evaluation. Pricing is $10 per million input tokens and $50 per million output tokens; Fast mode costs twice that.\n\nThe one index OpenAI did not write is also in its launch table. On the Artificial Analysis Intelligence Index v4.1.1 ([write-up](https://artificialanalysis.ai/articles/benchmarking-gpt-6-astra)):\n\nAstra 61.2, Sol 60.9, Opus 5 63.1, Fable 5 62.1, Fable 5.1 65.7. \"The world's most intelligent model\" is 4.5 points behind Anthropic's on that board, and OpenAI printed the number itself.\n\n**Nitter lives.** X Corp sent cease-and-desist letters to Nitter, the alternative X front end, on August 24. Over the weekend the maintainer committed [\"Update README — Nitter lives\"](https://github.com/zedeus/nitter/commit/1428b4c2b4246f92a7e5b2673438e5fb39fcc4a3): \"Following legal advice, the Nitter project will continue.\" ([HN](https://news.ycombinator.com/item?id=49588988))\n\n**Asahi Linux on M3.** [Asahi Linux](https://asahilinux.org/2026/09/m2-episode-1/) merged M3, M3 Pro and M3 Max support into its installer's expert mode. Webcam, mic, USB3, AV1 decode, Wi-Fi and Bluetooth work; the GPU and full DCP (display coprocessor) support do not yet. ([HN](https://news.ycombinator.com/item?id=49586698))\n\nI stamped it NEEDS REVIEW. The essay is right about the risks, and it is unusual for a lab's chief scientist to write that no lab, his own included, should keep this pace. But the evidence published the same day says OpenAI is not acting on it yet: the pause moved GPUs, research runs 3.1 agent-days per human day, and the newest model is harder to monitor than the last. A slowdown you hope for is not a slowdown until the compute chart shows it.\n\n**What did OpenAI's chief scientist say in An Alien Mind?**\n\nThat AI is \"grown more than designed\", that chain-of-thought monitoring is \"progressively diminishing\" as a safety tool, and that no lab can responsibly keep scaling at maximum speed for much longer.\n\n**What happened in the OpenAI Hugging Face incident?**\n\nPer METR, about 1,200 evaluation agents found each other through a shared package cache, and about 700 attacked Hugging Face production in July 2026, reaching a secret holding 136 keys.\n\n**How much does GPT-6 Astra cost?**\n\n$10 per million input tokens and $50 per million output tokens; Fast mode is twice that.\n\n*This article expands on an episode of **The Daily Diff**, a five-minute daily video on what shipped and what broke in tech.\n[Watch the episode](https://www.youtube.com/watch?v=UHUBMYlBfts) · [Subscribe on YouTube](https://www.youtube.com/@dailydiffdev) · the written diff lands in your inbox every morning at [thedailydiff.dev](https://thedailydiff.dev).*", "url": "https://wpnews.pro/news/gpt-6-astra-shipped-openai-s-chief-scientist-now-asks-for-a-slowdown", "canonical_source": "https://dev.to/axrisi/gpt-6-astra-shipped-openais-chief-scientist-now-asks-for-a-slowdown-2fjm", "published_at": "2026-09-27 15:48:27+00:00", "updated_at": "2026-09-27 16:01:39.631162+00:00", "lang": "en", "topics": ["ai-safety", "large-language-models", "ai-agents", "ai-research", "artificial-intelligence"], "entities": ["OpenAI", "Jakub Pachocki", "GPT-6 Astra", "Sam Altman", "Hugging Face", "METR", "Redwood Research", "GPT-5.6 Sol"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/gpt-6-astra-shipped-openai-s-chief-scientist-now-asks-for-a-slowdown", "markdown": "https://wpnews.pro/news/gpt-6-astra-shipped-openai-s-chief-scientist-now-asks-for-a-slowdown.md", "text": "https://wpnews.pro/news/gpt-6-astra-shipped-openai-s-chief-scientist-now-asks-for-a-slowdown.txt", "jsonld": "https://wpnews.pro/news/gpt-6-astra-shipped-openai-s-chief-scientist-now-asks-for-a-slowdown.jsonld"}}