{"slug": "ainews-death-of-params-z-ai-ceo-jie-tang-on-glm-5-3-and-the-new-post-training", "title": "[AINews] Death of Params: Z.ai CEO Jie Tang on GLM 5.3 and the new Post-training Scaling Law", "summary": "Z.ai CEO Jie Tang announced that GLM 5.3's performance gains come from reinforcement learning on long-horizon environments, not parameter count, and introduced a new post-training scaling law with five knobs including MoE sparsity. Tang stated that parameter count is only meaningful alongside data volume, compute allocation, and deployment conditions, and that advanced skills require carrying long causal chains of 20+ inference steps, which does not depend on total parameter count.", "body_md": "We’ve covered [GLM 5.2](https://www.latent.space/p/ainews-glm-52-the-top-frontend-coding?utm_source=publication-search) very excitedly before, and Prof Jie Tang’s belief that there will be an [open weights Fable-class model by end of the year](https://www.latent.space/p/ainews-glm-gpt-glm-52-passes-vibe?utm_source=publication-search) (*spot check - with 134 days left, there are now two 2-3T models ( Qwen 3.8 Max and Kimi K3) with estimates that Fable is 3-7T, and only 2 points higher on the AA index.)*\n\n[Prof Jie Tang is back on X](https://x.com/jietang/status/2089941544581403107) to tell us that our shorthand for model sizes is no longer enough: “*Parameter count is only meaningful alongside three others — how much data you have, where you intend to spend your compute, and who will run the model, under what conditions.”*\n\nWe have covered [Chinchilla ](https://www.latent.space/p/transformers-math?utm_source=publication-search)(and [post-Chinchilla](https://arxiv.org/abs/2401.00448)) scaling laws in past LS years, but, so we will skip the history lesson, but it is good to level-set on why Chinchilla’s assumptions were wrong in the [Inference Inflection](https://www.latent.space/p/ainews-the-inference-inflection) world (no fixed number, between 200-900 toks/param, citing [Roberts et al](https://arxiv.org/pdf/2604.01411) on task dependence).\n\nIn short: Memorization prefers more parameters. Reasoning prefers more post-training data and **effective depth**. [GLM-5.3’s ](https://z.ai/blog/glm-5.3)big jumps come solely from RL on long horizon environments:\n\nThe environments now cover a much broader range of production workflows, with tasks designed around how engineering and research work is actually carried out in practice.Some represent several days of work for an experienced engineer.In an ML infrastructure task, for example, the model may be given the same working environment as an engineer, withaccess to compute clusters, storage systems, internal documentation, codebases, and experiment results. It must diagnose bottlenecks across the training stack, implement optimizations, run experiments, and deliver a measurable end-to-end speedup while preserving correctness. Training on environments at this level pushes the model toward takingownership of substantial work end to end, rather than relying on users to decompose the problem and supervise each step.\n\nFor those following [the recursive self improvement story](https://www.youtube.com/watch?v=4sX_He5c4sI), their entire environment and judging and verifier process is synthetic all the way down:\n\nAs agent capability improves, much of the difficulty in scaling post-training moves from the model to the environment. A useful task environment has to be executable, verifiable, and close to real professional work — and we need many of them, not a handful of hand-built ones. To scale this process, we builtpipelines that synthesize environments end to end, and for a subset of tasks, the RL reward signal as well.Research agents collect task patterns from real work and turn them into runnable long-horizon environments with multi-step dependencies and hidden state; a judge agent then attempts each task to verify that it is actually solvable. Verifiers are synthesized without access to the reference solution, while solver trajectories are used to discover and close reward shortcuts. A verifier that passes oracle, no-op, and unsolved-state checks produces a binary reward reliable enough to train on directly.\n\nTo put an end to parameter count obsesssion, Prof Jie identifies 5 knobs of scaling, including MoE sparsity with the [new XA-YB notation](https://www.latent.space/p/ainews-thinkys-inkling-975b-a41b?utm_source=publication-search). He notes that advanced skills (e.g., finding software vulnerabilities) are not retrieval/memorization problems. **They require carrying long causal chains (20+ inference steps) without losing the thread.** This ability does not live in total parameter count once a certain knowledge-holding threshold is reached.\n\nAnd it looks like there is much more to go.\n\nAI News for 8/18/2026-8/19/2026. We checked 12 subreddits,\n\n[544 Twitters]and no further Discords.[AINews’ website]lets you search all past issues. As a reminder,[AINews is now a section of Latent Space]. You can[opt in/out]of email frequencies!\n\n**AI Twitter Recap**\n\n**Open-Weight Models, Compression, and Benchmark Movement**\n\n**Ornith-1.5 lands as a serious new open family**:[@ornith_](https://x.com/ornith_/status/2090074077084127302)released** Ornith-1.5**in** 9B dense, 35B MoE, and 397B MoE**variants under** MIT**, with quantized formats including** FP8, GGUF, MLX, and NVFP4**. The headline claim is end-to-end** self-improvement**: the model proposes tasks, generates scaffolds, and produces RL rollouts to create new training experiences. Reported evals are strong across agentic/coding workloads, including**Terminal-Bench 2.1: 86.1**,** SWE-Bench Verified: 86**,** DeepSWE: 56**,** HLE: 44.6**, and** Tool Decathlon: 71.2**. The release was quickly wired into serving stacks by[vLLM](https://x.com/vllm_project/status/2090243605147586955)and[Ollama](https://x.com/ornith_/status/2090276420983587087).**Compression continues to get more aggressive without fully collapsing utility**:[@UnslothAI](https://x.com/UnslothAI/status/2090103470015828184)and[@danielhanchen](https://x.com/danielhanchen/status/2090119165055324518)shipped new**Qwen3.8-27B GGUFs** using**Dynamic V3**, claiming roughly** 10% higher accuracy**at the same size and releasing** 1-bit quants**that still retain about** 77% of BF16 accuracy**while running on** 8GB RAM**. Their new** Divergence-300**metric extends top-1% greedy accuracy across longer generations using unseen examples from** Terminal Bench**,** DeepSWE**, and related tasks.** Agent and legal eval boards continue to reshuffle**:[@arena](https://x.com/arena/status/2090137780932538549)published a Pareto view of** Agent Arena**, where** Claude Opus 5 (High)**leads quality, but lower-cost models like** Kimi K3**,** GLM 5.2**,** Grok 4.5**, and** GPT-5.6 Luna**define much of the value frontier. Separately,[@ValsAI](https://x.com/ValsAI/status/2090119651204423763)reported** Grok 4.6**at**#3/49** on**Legal Research Bench** with**48.1%**,** 500k context**, tool/image/file support, and relatively low pricing. For open models,[@ValsAI](https://x.com/ValsAI/status/2090192848780136668)also highlighted**GLM 5.3** as**#2 on Terminal Bench**,**#3 on Legal Bench**, and**#6 on Skills Bench** among open weights.\n\n**Agent Harnesses Become the New Competitive Layer**\n\n**DeepSeek Harness’s minimalism is deliberate, not incomplete**: A detailed writeup amplified by[@ZhihuFrontier](https://x.com/ZhihuFrontier/status/2089998555889250478)and summarized by[@TheTuringPost](https://x.com/TheTuringPost/status/2090096803899216151)frames**DeepSeek Harness (DSH)** as an intentionally thin shell over a plugin architecture called**Cordis**. The key design choice is that** everything is a plugin**, including the agent loop itself. Early beta users reportedly shipped** 100+ plugins**and filed** 400+ issues**in under a week; examples range from a** gomoku model testbed**to a** database agent**that closes the SQL feedback loop by connecting the model to live query execution. The strongest takeaway is architectural: DSH is less “productized assistant” than**open agent runtime**, optimized for user-extensible tooling, swappable control loops, and business-rule injection.** TrueFoundry open-sources TrueForge and makes the harness-cost argument explicit**:[@truefoundry](https://x.com/truefoundry/status/2090081376330715176),[@omarsar0](https://x.com/omarsar0/status/2090138030296219973), and[@kimmonismus](https://x.com/kimmonismus/status/2090159374450974850)all covered the launch of**TrueForge**, an** MIT-licensed**, self-hostable, vendor-neutral harness for production agents. The stack includes tool orchestration, context management, subagents, code sandboxes, human approvals, and traces, with both**local** and**hosted** deployment modes. The technical claim that resonated: on a**14-task enterprise benchmark**, TrueForge matched** Claude Managed Agents**on** Opus 4.8**while using about** 30% fewer tokens**, and routing to** GLM-5.2**cut cost by around** 75%**while preserving accuracy. The broader industry theme—also echoed by[@bradenjhancock](https://x.com/bradenjhancock/status/2090114460828766567)and[@dbreunig via @rseroter](https://x.com/rseroter/status/2090146780658782517)—is that the**session/environment/memory/tools layer** is becoming a major source of both differentiation and savings.**Managed harnesses are also getting sharper observability and controls**:[@ClaudeDevs](https://x.com/ClaudeDevs/status/2090218983962390950)added** memory support for self-hosted sandboxes**,** domain allow/block controls**for web tools, and a redesigned** multi-agent session viewer**with** minimap**,** grouped transcript**, and** cost-per-thread/session**. OpenAI, meanwhile, continues pushing the opposite angle: give teams the harness primitives to embed into their own products.[@OpenAIDevs](https://x.com/OpenAIDevs/status/2090230646497251387)highlighted the**open-source Codex harness** as the runtime beneath internal tools, ops dashboards, and custom apps, while[@cursor_ai](https://x.com/cursor_ai/status/2090136956101414982)shipped cloud-agent UX improvements around persistent goals and long-lived sessions.\n\n**Post-Training, Mid-Training, and RL Systems Work**\n\n**More evidence that scaling is shifting from parameters toward training recipe quality**:[@kimmonismus](https://x.com/kimmonismus/status/2090026799916888080)surfaced a notable claim from the** zAI/GLM**founder: progress is still scaling, but too much discourse has fixated on parameter count rather than** data quality, inference compute, and post-training**. The cited example is** GLM-5.3**, reportedly based on the same core base model/architecture as** GLM-5.2**, but improved substantially via about** one month of extra RL**.** Microsoft’s Agent Lightning points at RL-through-the-harness as a practical recipe**:[@omarsar0](https://x.com/omarsar0/status/2090078336697733531)highlighted** Agent Lightning v1.0**, which connects arbitrary harnesses to RL through an endpoint proxy, handling issues like** retokenization, sample merging, advantage calculation, normalization, and scheduler/backend coordination**. With**~6K training examples** and modest compute, it reportedly moves**Qwen3.5-9B** on**SWE-Bench Verified** from**41.8% to 56.4%**.** Mid-training is being treated more explicitly as an optimization surface**:[@cwolferesearch](https://x.com/cwolferesearch/status/2090080281248325744)laid out the current practitioner view of** CPT/midtraining**: optimize** data mixture**,** duration**,** stage ordering**,** sequence length**, and even** post-trainability**rather than just “continue pretraining on better data.” The thread is useful precisely because it frames these as interacting knobs rather than independent tricks.**RL infrastructure keeps improving underneath the research**:[@SergioPaniego](https://x.com/SergioPaniego/status/2090052408940666888)resurfaced work showing** on-policy distillation in TRL**becoming** 40x faster**via generation buffers, batched teacher calls, and binary logprob encoding;[@mikasenghaas](https://x.com/mikasenghaas/status/2090212176166629474)announced**adaptive concurrency** in**prl**, dynamically adjusting in-flight rollouts over the course of an RL run.\n\n**Benchmarks, Retrieval, and Infra Details That Matter in Production**\n\n**Qdrant’s filterable HNSW vs ACORN is a substantive retrieval systems update**:[@qdrant_engine](https://x.com/qdrant_engine/status/2089999409404957029)argued that filtered ANN should be addressed in the**index**, not only at query time. Their** filterable HNSW**adds edges between points sharing indexed payload values, keeping filtered subgraphs connected. In their benchmark on a** 1% filter over 1M vectors**, they report** 99.8% recall at 1.0ms**versus** 67.7% at 4.7ms**for** ACORN**. They also note ACORN still helps for** broad values**and** AND filters**, especially atop a graph already optimized for filters.** Sentence Transformers v6.0 reflects the practical move from single-vector to multi-vector retrieval**:[@tomaarsen](https://x.com/tomaarsen/status/2090018110052987171)summarized the distinction clearly: dense retrieval compresses each text into one vector, while**multi-vector** retrieval keeps token-level vectors and scores query tokens against document tokens before aggregating best matches. That matters because late-interaction retrieval is increasingly the default tradeoff for quality-sensitive search systems.**Production agent latency often has little to do with the model itself**:[@dair_ai](https://x.com/dair_ai/status/2090117595907383672)summarized a paper instrumenting ten agentic apps and finding that**non-LLM components dominate latency in half of them**, with** sandbox memory peaking at 28GB/session**,** up to 32x latency variation**across subsystems, and long idle state retention between steps. The optimizations are unsurprising but important:** task-aware serving**cuts latency** 29–40%**,** state offloading**reduces memory** 4.6x**, and** tool-result caching**removes** 35.2%**of redundant search calls.** Linear and turbopuffer show vector infra creeping into non-search hot paths**:[@turbopuffer](https://x.com/turbopuffer/status/2090091547585065283)said Linear moved its** delta sync read path**from** Postgres**to** turbopuffer**, using attribute indexes for permission filters and reducing the largest syncs by about** 8 seconds**.\n\n**Google, OpenAI, Anthropic, and the Productization Race**\n\n**Gemini 3.7 Flash had a strong day on both evals and product integration**:[@_philschmid](https://x.com/_philschmid/status/2090063976872751408)and[@NewsFromGoogle](https://x.com/NewsFromGoogle/status/2090120394141266141)highlighted**Gemini 3.7 Flash** taking**#1** on Artificial Analysis’s**AA-AnalystAgent**, with** 60.0% pass^5**,** 70.5% pass@1**,** 77.5% pass@5**,** 1.32s/task**, and**$0.54 average cost** across**80 spreadsheet/document-heavy quantitative tasks**. Google also pushed it deeper into product surfaces:[Gemini chat and Spark](https://x.com/Google/status/2090113238436315618),**Search-based interactive simulations** built on the fly in AI Mode ([example](https://x.com/rmstein/status/2090177397006168437)), and[AI Studio GitHub sync](https://x.com/GoogleAIStudio/status/2090149753312932026)for build workflows.**OpenAI is leaning into low-cost deployment and privacy positioning**:[@Replit](https://x.com/Replit/status/2090076648276185555)launched** Free Mode**powered by** GPT-5.6 Luna**, which[@kimmonismus](https://x.com/kimmonismus/status/2090111297039765703)framed as a meaningful efficiency win: a model that would recently have been SOTA is now cheap enough to be given away broadly. On the enterprise side,[@OpenAI](https://x.com/OpenAI/status/2090165328290701800)introduced**Private Safety Processing**, aiming to preserve** Zero Data Retention**for frontier models while still detecting cross-interaction safety risks without human access to the underlying content.** Anthropic continues to tighten the developer ergonomics loop**: beyond the managed-agent updates above,[@ClaudeDevs](https://x.com/ClaudeDevs/status/2090245922685063634)added a** Concise output style**to Claude Code, another sign that product teams are now tuning not just capability but response-shape as a first-class UX variable.\n\n**Top tweets (by engagement)**\n\n**Ornith-1.5 release**:[@ornith_](https://x.com/ornith_/status/2090074077084127302)unveiled an** MIT-licensed**open model family from** 9B to 397B**, with strong coding/agentic benchmark claims and broad quantization support.** OpenAI privacy/safety infrastructure**:[@OpenAI](https://x.com/OpenAI/status/2090165328290701800)announced** Private Safety Processing**while reaffirming** Zero Data Retention**for frontier models.** Gemini student push and product bundling**:[@GeminiApp](https://x.com/GeminiApp/status/2090165248196252003)offered a year of Gemini plans to students globally while rolling out new study-oriented features.**Claude Code UX update**:[@ClaudeDevs](https://x.com/ClaudeDevs/status/2090245922685063634)shipped** Concise mode**, a small but widely noticed improvement for day-to-day coding-agent interaction.** OpenRouter acquisition**:[@patrickc](https://x.com/patrickc/status/2090125021910020520)confirmed** OpenRouter is joining Stripe**, a move many interpreted as validation that** token routing/marketplaces**are becoming core infrastructure rather than edge tooling.\n\n**AI Reddit Recap**\n\n**/r/LocalLlama + /r/localLLM Recap**\n\n**1. Qwen/DeepSeek Open-Weight Inference Speedups**\n\n(Activity: 1428):[Introducing Qwen3.8-27B Dynamic v3 Unsloth GGUFs](https://www.reddit.com/r/LocalLLaMA/comments/1vsr67c/introducing_qwen3827b_dynamic_v3_unsloth_ggufs/)**The image is a technical announcement graphic for “Dynamic v3.0 Qwen3.8”, showing Unsloth’s new Qwen3.8-27B Dynamic v3 GGUF post-training quantizations and claiming**`>10%`\n\n**higher top-1% accuracy at the same GGUF size versus other providers. It includes a memory table suggesting the model can run from 1-bit quants on ~**`8GB`\n\n**RAM up to BF16, plus a chart comparing accuracy across quant sizes; the post links the GGUF release on**[Hugging Face](https://huggingface.co/unsloth/Qwen3.8-27B-GGUF), the[Dynamic 3.0 docs/benchmarks](https://unsloth.ai/docs/basics/dynamic-3.0-ggufs), and the[image itself](https://i.redd.it/it09zxtsxckh1.jpeg). Unsloth emphasizes these are post-training quantization releases only—**“we do NOT use QAT or QAD”****—and says the imatrix calibration file is public for independent evaluation and fine-tuning experiments.** Comments were mostly positive, but one technical request asked Unsloth to add the previous**UD 2.0** quants to the graph so users can compare against what they already have locally. Another commenter asked for deeper diagnostics, specifically per-category and**KV-cache quantization KLD** numbers, referencing localbench-style reporting.Several commenters requested more detailed quantization evaluation for the new\n\n**Qwen3.8-27B Dynamic v3 Unsloth GGUFs**, especially a direct graph line comparing against the prior** Qwen 3.8 27B UD 2.0**quants. Suggested metrics included** KLD**and/or** top-1 agreement**, which would help users judge whether the new dynamic quantization is materially better than the versions many already have stored locally.A commenter asked for\n\n**per-category KLD** and**KV-cache quantization KLD** reporting, referencing the style of breakdowns from[localbench.substack.com](https://localbench.substack.com/). This would make the quant quality discussion more actionable by showing which benchmark/task categories or cache-quant settings degrade most under different GGUF quant formats.There was interest in the practical memory footprint of the quants: one user noted\n\n`~15 GB`\n\n**for Q4_K_M**, while another inferred that** IQ4_XS may now fit on**`16 GB`\n\n**VRAM**“without mtp.” The technical concern is whether these smaller formats maintain model quality closely enough to justify running a 27B-class model fully on common consumer GPUs.", "url": "https://wpnews.pro/news/ainews-death-of-params-z-ai-ceo-jie-tang-on-glm-5-3-and-the-new-post-training", "canonical_source": "https://www.latent.space/p/ainews-death-of-params-zai-ceo-jie", "published_at": "2026-08-20 05:17:12+00:00", "updated_at": "2026-08-20 05:43:12.681925+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-research", "ai-products"], "entities": ["Z.ai", "Jie Tang", "GLM 5.3", "Qwen 3.8 Max", "Kimi K3", "Fable", "Chinchilla", "Roberts et al"], "alternates": {"html": "https://wpnews.pro/news/ainews-death-of-params-z-ai-ceo-jie-tang-on-glm-5-3-and-the-new-post-training", "markdown": "https://wpnews.pro/news/ainews-death-of-params-z-ai-ceo-jie-tang-on-glm-5-3-and-the-new-post-training.md", "text": "https://wpnews.pro/news/ainews-death-of-params-z-ai-ceo-jie-tang-on-glm-5-3-and-the-new-post-training.txt", "jsonld": "https://wpnews.pro/news/ainews-death-of-params-z-ai-ceo-jie-tang-on-glm-5-3-and-the-new-post-training.jsonld"}}