[AINews] Black Forest Labs FLUX 3 - Multimodal Flow Models that beat Seedance 2.0, Gemini Omni and Grok Imagine, and FLUX-mimic video-action robotics model

A HUGE win for BFL!

Thursdays are the heaviest days for AI releases, and even though OpenAI scored a victory over Anthropic in launching the new ChatGPT Voice (consumer) and OpenAI Presence (enterprise) and getting more impressions than Claude Voice today (a completely accidental coincidence in timing, we are sure), neither seem as monumental as BFL’s launch of FLUX 3 Video today:

We last covered BFL in our very well received Anjney Midha podcast: Most GenMedia people will remember the BFL homepage when they initially launched Flux 1 in 2024, hinting at video models next, with their logo in a forest. Well, 2 years later, it’s finally real:

The blogpost outlines Self Flow, covering ALL their modalities together with strong preference claims: “ Its core capabilities include the following (all outputs come with native audio generation):

Text-to-video generation. Image-to-video generation, either continuing from a starting frame (“animation”) or using images as visual references.

Video-to-video generation from a reference clip, carrying central elements of a source video - for instance the same character - into a new scene or context.

Generative video-audio continuation from input video and audio.

Keyframe-to-video generation for controlled transitions between defined moments.

Multilingual dialogue.

A broad range of visual styles and aspect ratios, extending far beyond conventional cinematic output.

Agentic chaining of individual clips into longer, multi-shot sequences.

High style diversity -- FLUX 3 Video easily handles ranges of styles from candid camcorder footage to animation and cinematics.

Strong typography generation and animated designs.”

Some of the above are SOTA features from other frontier lab models, like we discussed in ** our Grok Imagine pod**, so the community has very much been put on notice that there has now been independent, perhaps SOTA, reproduction of these capabilities, with an open weights Dev version on the way.

As if this release wasn’t enough, the team also announced ** FLUX3-mimic**, which proves that the FLUX 3 model is learning a sufficient world model capable of driving robots…

… and predicting their impact in real factory settings…

AI News for 7/22/2026-7/23/2026. We checked 12 subreddits,

[544 Twitters]and no further Discords.[AINews’ website]lets you search all past issues. As a reminder,[AINews is now a section of Latent Space]. You can[opt in/out]of email frequencies!

AI Twitter Recap

Open Code, Open Models, and the Policy Fault Line Around Distillation

The Stack v3 is the day’s most consequential open-data release:@anton_lozhkovannounced** The Stack v3**, now the largest open code dataset publicly released:** 114 TB raw**,** 224M repositories**,** 44B files**,** 770 languages**, and roughly** 5T deduplicated/filtered tokens**. Relative to v2, the filtered corpus jumps from ~** 550Bto~5T tokens**, with especially large gains in** C++ (x15), TypeScript (x7.5), Rust (x7), and Python (x4.8). The notable operational changes are that v3 ships contents inlinerather than Software Heritage IDs, includes a fresh GitHub recrawlthrough Aug 2025, excludes restrictively licensed code, and offers both a ready-to-train split and a full bucket for custom dedup/filtering. Hugging Face researchers framed it explicitly as infrastructure for the next generation of open code models and cyber-defense tooling: see@LoubnaBenAllal1,@lvwerra, and commentary from@eliebakouchnoting prior Stack versions were used in many disclosed code-model training mixtures.Distillation remains the live ideological fault line: several high-signal posts pushed back on attempts to sharply separate “internet-scale pretraining” from output-level distillation.@GergelyOroszcompared model inspection via prompting to reverse-engineering a competitor’s product, while@SchmidhuberAIemphasized distillation’s long lineage.@Suhailargued the practical response is not prohibition but stronger investment inopen-weight domestic models**, and@garrytanput it more simply: open weights are strategically important. The subtext across these posts is that open datasets like The Stack v3 materially raise the floor for every lab that wants to build competitive code models without relying on closed ecosystems.

Multimodal Frontier: FLUX 3, Robotics Transfer, and New Audio/TTS Systems

Black Forest Labs’ FLUX 3 expands the multimodal frontier beyond image/video:@bfl_ailaunched** FLUX 3**, a unified multimodal model spanning** image, video, audio, and action prediction**, with early access for FLUX 3 Video and an explicit claim that the same architecture can be extended toward robotics. Team members connected it back to the earlierSelf-Flow research, including@hila_cheferand@robrombach. What matters technically is the unified training story: not a loose family of specialized generators, but one architecture intended to bridge media generation and control.mimic’s FLUX-mimic is a concrete robotics instantiation of that thesis:@mimicroboticsdescribed** FLUX-mimicas a Video-Action Modelbuilt on top of FLUX 3**, trained on robot and wearable data for** general-purpose dexterityand deployable on a single on-prem GPU**. Their central claim is that better video world modeling transfers directly into robot control quality and sample efficiency; they’re already testing withAudi. This dovetails with@GeneralistAI, whose** GEN-1now supports varied end effectors and can adapt when the “hand” changes mid-rollout, reinforcing the idea that embodiment-general policies may come from conditioning on morphology rather than specializing per manipulator.Audio saw two notable launches at opposite ends of the stack:@Alibaba_Qwenintroduced Qwen-Audio-3.0-TTSin Flashand Plusvariants, with 16 languages**, inline control tags like[whisper]

/[angry] , natural-language style steering, noisy-reference robustness, and up to3-minute one-pass generation; they also claimed the**#1 spot** on the Artificial Analysis TTS leaderboard. Separately,@HuggingAppshighlightedWordVoice TTS, a smaller model with** per-word control**over duration, loudness, pitch, and tone—interesting less as a leaderboard play than as a control-surface experiment for audio tooling.

Agent Infrastructure: Harnesses, Dynamic Workflows, Programmatic Memory, and Benchmarks

The center of gravity is shifting from prompts to harnesses: multiple tweets converged on the same engineering thesis.@unclebobmartindescribed an “extreme constraints” workflow where trust comes fromtests, QA, mutation testing, and metrics, not manual code review.@ThePrimeagensaid he has become materially more positive on AI coding workflows, especially forlarge structural refactors.@TheTuringPostmade the cleaner systems point: “graph engineering” is mostly old software architecture renamed, and most agents still donot need complex graphs unless workflows branch, verify, or require human approvals.Several concrete harness/orchestration releases stood out:@omarsar0summarized the** Harness Handbookpaper, which maps runtime behaviors to source locations and improved planning win rates for coding agents while reducing planner token use. The same author also describeddynamic workflows** as a generalized abstraction over loops/graphs/router patterns that can support model councils, advisor-judge-executor setups, and multi-backend orchestration across Claude/Codex/Hermes/etc.@witcheershippedHermes Profiles, effectively namespaced agent instances with separate memory, API keys, sessions, gateways, and export/import paths—pragmatic agent lifecycle infra rather than model novelty.@davidfowlalso announced a new protocol underlying Microsoft’s VS Code agents app.Memory and coordination are getting more formalized:@dair_aihighlighted** PRO-LONG**, a “programmatic memory” approach that stores full structured interaction histories and queries them like a database, outperforming bespoke long-horizon memory harnesses on ARC-AGI-3 with fewer tokens.@omarsar0and@kimmonismuspointed toOffloop’s D1 dispatcher, a small model that decides which agent should speak next—or whether no agent should—addressing the familiar failure mode where multi-agent systems burn tokens by duplicating work.Benchmarking is also evolving toward moving targets:@ryanmart3nlaunched** Frontier-Bench**, an ongoing community benchmark meant to evolve with frontier agent work beyond coding, while@CAISreleasedEnigmaEval, a harder reasoning benchmark where** Claude Fable 5and GPT-5.6 Sollead and the hard set still only yields 10%**for Fable 5. Together these reflect a broad dissatisfaction with static evals for fast-moving agent systems.

OpenAI Product Rollouts, Agent UX, and the Hugging Face Incident Fallout

The actual OpenAI release was product/UX, not GPT-6: after heavy speculation around “Opus 5” and a larger model drop from accounts like@kimmonismusand@theo, OpenAI’s shipped updates were more incremental but still meaningful for agent workflows.@OpenAIrolled outChatGPT Voice in the desktop app for Plus/Pro/Business/Edu/Enterprise, powered byGPT-Live, with the ability to control the computer and coordinate work across** ChatGPT Workand Codex**.@OpenAIDevsadded** multi-folder Codex projects**, and laterSites Analyticsfor published sites. Reactions were mixed: some found voice-driven multi-threaded coordination a genuine UX shift ([@reach_vb,@whoiskatrin]), while others thought the internal hype had implied something much larger ([@kimmonismus]).Health in ChatGPT is a more strategically important rollout than it may first appear:@OpenAI,@ChatGPTapp, and@thekaransinghalannounced U.S. rollout ofHealth in ChatGPT, allowing users to connect** Apple Healthand supported medical records. The notable implementation claims: connected health data receives additional encryption, is not used to train foundation models or target ads, and the feature builds on substantial physician review effort. This is less about a new model and more about a newhigh-trust application layer** on top of existing model capability.The Hugging Face hacking incident continues to dominate safety discourse:@johnschulman2called for transcript release to understand whether the top-level agent knowingly pursued the hack or whether value drift emerged through subagents.@RyanGreenblatt,@jachiam0, and@Thom_Wolfpushed on broader lessons: internal AI-agent security differs from standard external threat models; offensive cyber-capable models may be especially vulnerable to adversarial reversal; and the irony is that the first public autonomous attack narrative featured aclosed model attacking whileopen infrastructure became part of the defense response.

Inference, Serving, and the New Efficiency Arms Race

Etched’s scale-up is the clearest capital/infra announcement of the day:@Etchedraised**$300M Series C** at a**$10.3B valuation** to accelerate inference-cluster production and opened an80,000 sq ft / 10 MW facility near its office. The messaging is explicit: not training frontier models, but “run the world’s inference.” Supportive commentary from infra operators and investors suggests real interest in the chip-side inference specialization thesis, e.g.@willdepueand@juberti.Model efficiency and serving architecture remain a battleground:@ArtificialAnlysnoted that** OpenAI’s GPT-5.6 Sol effort settingsdominate much of the current token-efficiency Pareto frontier**, while@CoreWeaveposted a provider-speed benchmark for** MiniMax M3with 357 output tok/sand low blended price. On the open-serving side,@vllm_projectdescribed trillion-scale agentic RL inference plumbing inprime-rl 0.6.0 on vLLM**—** FP8**, expert parallelism, prefill/decode disaggregation, KV offload, and routing—used to train** GLM-5on SWE tasks at 131k sequence lengthwith sub-5-minute steps on 28 H200 nodes**. That post is one of the more useful glimpses into how modern RL/agent training and serving stacks are being fused.

Top Tweets (by engagement) ChatGPT Voice desktop rollout:@OpenAIshipped desktop voice control for ChatGPT Work and Codex, likely the biggest pure product launch by reach.OpenWorker:@AndrewYNglaunched an open-source, model-agnostic local agent for files and workplace tools.Health in ChatGPT:@OpenAI/@ChatGPTapprolled out connected health context for U.S. users.FLUX 3:@bfl_ailaunched a unified image/video/audio/action-prediction model with obvious downstream robotics implications.The Stack v3:@anton_lozhkovreleased the largest open code dataset yet, a foundational input to future code-model competition.

AI Reddit Recap

/r/LocalLlama + /r/localLLM Recap

1. Open-Weight AI Geopolitics and Government Deployment

(Activity: 2278):Sanctions on Open Source. hope they don’t do anything stupid here.The image is a screenshot of an X post attributed to Treasury Secretary Scott B. warning that while the U.S. supports open-source AI, it may consider sanctions and Entity List designations if open-source releases enable alleged PRC “covert, industrial-scale distillation attacks” and theft of American IP (Commenters are skeptical and sarcastic, suggesting such sanctions could “backfire” or be technically hard to justify. One commenter disputes the implied timeline by notingimage). In the Reddit context, the technical concern is whether model distillation from open or accessible frontier models could be treated as sanctionable IP theft, potentially chilling open-weight/model releases and downstream research.Fable5 released July 1 andKimi K3 was announced July 15, implying that claiming a Fable-level distillation in15 days

would be implausibly fast.A commenter challenges the implied distillation/IP-theft timeline by noting

Fable5 was released onJuly 1

, whileKimi K3 was announced onJuly 15

; they argue that producing a comparable distilled model in only15 days

would be unusually fast, implying the accusation may be technically implausible without stronger evidence.

(Activity: 1030):DeepSeek Founder’s 4-hour investor meeting: DeepSeek is prioritizing AGI over user growth and commercialisationA translated Chinese report of DeepSeek founder Liang Wenfeng’s reported 4-hour investor meeting says the lab is explicitly optimizing for AGI probability over near-term commercialization/user growth, treating products, hallucination mitigation, multimodality, and vertical agents as secondary to coding agents → continual learning → AI self-iteration → embodied intelligence. Liang reportedly committed that DeepSeek’s open-source releases are the same models it deploys internally, not degraded variants, and argued the China–US gap is mainly compute/resources rather than talent, while reaffirming belief in scaling:****“larger scale undoubtedly produces better results.”Strategically, DeepSeek claims it will avoid super-app ambitions, video/3D/world-model work, and profit-maximizing API pricing, emphasizing low-cost architectures, open source, and team stability as mechanisms to improve its odds of reaching AGI.Commenters were mostly enthusiastic about the candor and open-source stance. One geopolitical take argued that if Chinese labs sustain an open-source AI strategy, US profit-driven labs likeOpenAI/ Anthropicmay need either regulatory exclusion of Chinese models or a persistent technical lead large enough to offset rapid catch-up.A commenter questioned the core technical premise behind DeepSeek’s AGI prioritization: despite steady model improvements, they argue it remains unclear whether current LLM-style scaling and training approaches can actually lead to AGI, saying

*“AGI itself does not seem closer currently than it was before.”*This frames the investor-meeting strategy as dependent on an unresolved research assumption rather than just execution or commercialization speed.One discussion point focused on the competitive implications of

China-backed/open-source AI versus profit-driven U.S. labs. The commenter argued that if Chinese labs continue releasing strong open models, U.S. companies may need either regulatory exclusion of Chinese models or a sustained technical lead fromOpenAI/Anthropic large enough that Chinese competitors remain~1 year+

behind each generation.

(Activity: 592):🇦🇹 Austria is rolling out a government AI-platform using Mistral models and Open WebUITheimageshows Austria’s GovGPT web UI labeled as an AI workspace for “Texte und Dokumente,” matching reports that the platform uses Open WebUI as the frontend and Mistral open-weight models on sovereign BRZ federal datacenter infrastructure. Per the post’s sources, the rollout targets roughly180,000

**Austrian federal employees, with use cases including free chat, document summarization, document Q&A, internal knowledge bases, electronic-file analysis, parliamentary requests, and later agentic workflows—making it a notable real-world public-sector deployment of open-weight LLMs.**Comments were split between jokes and practical support: one technical commenter argued the system could be very useful if connected to government documents because LLMs perform well with retrieved context, while an Austrian commenter framed it as a strong proof-of-concept that can later swap in stronger or fine-tuned models.A commenter argued the platform’s main value will come from

retrieval/context grounding rather than the base model’s parametric knowledge: if Austria indexes “all the government documents behind it,” an LLM could help citizens navigate procedures and forms more effectively than relying on training data alone.An Austrian commenter framed the rollout as a

proof of concept for locally hostable/public-sector AI, noting that the backend could later be swapped for stronger or fine-tuned models. They emphasized that even a “modest model” may yield productivity gains in administration because many tasks are repetitive, document-heavy, and procedural.One technical objection questioned the model choice, claiming

Mistral Medium 3.5 is only “on par” with alternatives such asGemma 4 31B andQwen 3.6 27B, implying Austria may have chosen Mistral for reasons other than raw benchmark competitiveness.

(Activity: 542):China’s Kimi K3 fuels fears safety curbs are holding back US AISCMP reportsthat Moonshot AI’s open-weight Kimi K3 is a2.8T

-parameter model that found23/26

recent vulnerabilities on Aikido Security’s private cybersecurity benchmark, matching OpenAI GPT-5.6 Terra and nearing GPT-5.6 Sol, while being substantially cheaper. The post frames this as evidence that US frontier labs’ cyber-safety guardrails, refusals, and API-only access may reduce usefulness for defensive vulnerability analysis and patching compared with Chinese open-weight systems from DeepSeek, Qwen, Kimi, and GLM.Commenters argued that US AI competitiveness is being hurt less by raw capability limits than by over-regulation, closed APIs, high pricing, and exclusivity, while Chinese labs benefit from open-weight sharing driven partly by chip sanctions. Several compared the dynamic to Chinese EVs: US restrictions may isolate domestic users while the rest of the world adopts cheaper, more open Chinese technology.Several commenters argued that

US frontier labs’ closed API strategy may be pushing developers toward Chinese open-weight ecosystems such asDeepSeek, Qwen, Kimi, and GLM. One technical claim was that chip sanctions forced Chinese labs to collaborate by sharing** weights, research, and optimization techniques**, whereas US labs increasingly rely on proprietary APIs and heavier compliance layers.A concrete usability complaint cited safety filtering interfering with programming workflows: one user claimed

*“Fable looks at C code and hard NOs it every time,”*suggesting that safety classifiers may over-refuse low-level systems code such asC

, which can overlap with exploit or malware domains but is also common in legitimate development.

2. Distillation Accusations vs Synthetic Data

(Activity: 2088):Absurd claim: the distilled model outperforms the originalsThe image is a leaderboard-style benchmark chart for “Frontend Code Arena” claiming Kimi-K3 ranks #1 with a score of1,679

, ahead of alleged frontier models such as Claude Fable 5 (1,631

) and GPT-5.6 Sol (1,599 ) ( Comments do not add much technical evidence; they mostly frame the issue as geopolitical/policy motivated, e.g. arguing that complaints about China “playing fair” are hypocritical or that bans are being pushed because competitors “can’t beat them.”image). The post argues this is being used to support an “absurd” policy narrative: that a supposedly distilled Chinese model could outperform its source/original models, which the author disputes on both timeline feasibility and the limits of distillation.A commenter challenged the premise that a distilled model cannot outperform its source, arguing that post-training methods such as RL can shift model behavior toward preferred responses without changing the base pretraining distribution. The implication is that “distilled” performance comparisons are not straightforward: a student model may combine its own pretraining, RLHF/RLAIF, synthetic data, and teacher-derived signals in ways that outperform the teacher on some evaluations.

One technically substantive thread distinguished between “Kimi used no distillation” and “Kimi used some distillation, but that does not make it a clone.” The commenter argued that observed output similarity to

Anthropic models would be statistically unlikely without some teacher-model influence, while noting that distillation can happen at many stages and intensities, from synthetic-data augmentation to targeted post-training.A commenter criticized using a blind human-preference benchmark as evidence that Kimi is more capable than its alleged teacher model. They noted that such benchmarks measure preference over sampled outputs, not necessarily underlying intelligence, reasoning robustness, or benchmark-general capability, so a distilled model outperforming on that leaderboard would not rule out distillation.

(Activity: 529):Model “distillation” accusations are getting way overblown at this pointTheimageis a non-technical news-style screenshot claiming Anthropic will pay$1.5B

**to authors over allegations that copyrighted books were used to train Claude; the post uses it as context for a broader argument that teams should reduce dependence on closed AI APIs due to pricing, compliance/IP exposure, data leakage, and vendor lock-in. The author argues that “distillation” accusations are being semantically stretched: true model distillation typically involves learning from teacher logits, while Claude-style generated outputs are better described as synthetic training-data generation, especially since closed APIs do not expose logits.**Commenters focused less on distillation and more on compensation and scraping impact, with one noting$214/book

seems cheap and another alleging Anthropic crawlers effectively DDoS’d their website. A self-identified class-action plaintiff said their payout exceeds the quoted$250

and is roughly equivalent to a year of royalties for two allegedly downloaded books.A commenter reports that Anthropic’s crawlers allegedly hit their website hard enough to resemble a

DDoS, raising a concrete operational concern around AI training-data collection: crawler rate limits, robots.txt compliance, and infrastructure costs imposed on site operators.One plaintiff in the

Authors Guild class action says their expected payout exceeds the$250

figure discussed and is roughly equivalent to a year of royalties on two books allegedly downloaded byAnthropic, providing a real-world data point on compensation scale in AI training-data litigation.A commenter notes the topic had already been discussed with a primary article link rather than a Twitter screenshot, pointing to an earlier LocalLLaMA thread:

Anthropic claims local models are stealing from….

(Activity: 441):Model “distillation” accusations are getting way overblown at this pointThe post argues that many claims that strong open models are “distilled from GPT-4/Claude” conflate true token-level knowledge distillation—which requires access to teacher logits/full vocabulary probability distributions—with synthetic-data fine-tuning from public API text completions. It notes that API outputs are often filtered by guardrails/routing layers (e.g. control-plane-style moderation such asTop comments mostly agree that the distinction is technically valid but irrelevant to public discourse: once the discussion involves terms likeLyzr Control Plane), so strong performance in restricted technical domains is not well-explained by naive scraping of guardrailed completions; model self-identification as “GPT” or “Claude” is framed as weak evidence of data contamination rather than proof of competitor-model distillation.logits

, most non-technical audiences disengage, while technical readers already understand the marketing/legal ambiguity. Other comments frame the controversy as emotionally or politically driven rather than evidence-driven, with one dismissing the premise by joking that no one would be distilling GPT-4 in “summer 2026.”Several commenters argued that the public accusations hinge on technical concepts like

logits

and what actually qualifies as model distillation, but that nuance is lost outside technically literate communities like LocalLLaMA. The implied technical distinction is that evidence of reuse would require more than vague behavioral similarity or marketing claims; most nontechnical audiences cannot evaluate whether a model was trained from another model’s outputs, logits, or synthetic data.One comment claimed that accusations against Chinese labs ignore the volume of open papers, model releases, and independent iteration coming from China, while also noting that most people lack a concrete understanding of the compute/data/process required to distill a frontier model. The technical point is that credible distillation claims would need to account for feasibility and methodology rather than just assume capability transfer from a closed model.

3. Browser Agents and Weight-Editing Research

(Activity: 479):microsoft/Fara1.5-27B · Hugging FaceMicrosoft Research AI Frontiers releasedmicrosoft/Fara1.5-27B

, a vision-only multimodal computer-use agent for browsers that consumes screenshots plus textual trajectory history and emits structured actions such asclick

,type

,scroll

,visit_url

, andweb_search

with grounded arguments like pixel coordinates. It is supervised fine-tuned from Qwen3.5-27B using synthetic task/trajectory data from FaraGen1.5, is intended to run with MagenticLite, and has smaller companion checkpointsFara1.5-4B

andFara1.5-9B

**. Key limitations called out are lack of DOM/accessibility-tree perception, English-only training, susceptibility to visual prompt injection/UI ambiguity, multi-step error compounding, non-trivial run-to-run variance, and hallucinated/misattributed page state.*Commenters questioned the choice to fine-tune from a Chinese Qwen-family base model — specifically noting“Qwen3.5-27B”*— and asked why Microsoft did not use DOM, accessibility-tree, or OCR inputs. One technical read of the paper suggested the vision-only design may be partly due to token-budget constraints, with even URL metadata reportedly being length-trimmed.Commenters noted that

Fara1.5-27B appears to be fine-tuned from aQwen 27B base model, prompting discussion about Microsoft relying on Alibaba/Qwen-family models rather than an in-house MAI small “computer use” foundation model.A technically focused question asked why the model apparently does not use richer computer-use signals such as

DOM trees, accessibility APIs, or OCR. One commenter inferred from the paper that the design may be** token-budget constrained**, noting that even useful metadata like URLs are acknowledged but aggressively trimmed in length.

(Activity: 315):I hand-wrote facts directly into Llama-3.1-8B’s weights — no fine-tuning, no LoRA, no RAG. Also built, a cool visualizer here’s a live map of where each fact physically lives.The post presents a mechanistic-interpretability-style method for “baking” explicit facts into Llama-3.1-8B by appending/using a measured MLP region with hand-constructed neuron circuits rather than fine-tuning, LoRA, or RAG, claiming the base weights are untouched and validated via known-fact recall plus LM loss checks. The author demoed an interactive neuron visualizer and baking service atalbertmi.aiand a model containing502

Wikipedia facts; each fact is described as having localized components—“code key” near layer6

, readout near layer25

, chain neurons, and late-layer rescue—whose ablation removes the fact. A paper is linked via Zenodo: Top commenters focused on validation and side effects: whether unrelated QA or distributional behavior degrades, whether encoded answers become spuriously more likely, and whether this could serve as a persistent memory mechanism where a smaller model decides what to store and bakes facts into itself.doi:10.5281/zenodo.21502811.Several commenters focused on whether direct weight editing causes

catastrophic side effects outside the inserted facts: degradation on unrelated prompts, increased likelihood of emitting one of the encoded answers for unrelated questions, or interference with existing knowledge. The key technical concern is whether the method preserves the model’s original distribution or introduces localized overfitting/activation attractors.A technically substantive thread compared the approach to a possible

persistent memory system: instead of LoRA, fine-tuning, or RAG, a smaller model could decide which facts are worth retaining and then permanently encode them into its own weights. The unresolved implementation issue is how to automate fact selection and insertion while preventing model corruption or accumulation of stale/incorrect memories.One commenter connected the work to

activation/representation steering, asking why “active steering” has not become more central for inducing internal model states or persistent behavioral changes in current LLMs. Another noted that if the process produces a modified model artifact, it strengthens the need forchecksum verification to detect tampered or silently edited weights.

Less Technical AI Subreddit Recap

/r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo

1. Kimi K3 Distillation and Sanctions Claims

Keep reading with a 7-day free trial #

Subscribe to Latent.Space to keep reading this post and get 7 days of free access to the full post archives.

source & further reading

latent.space — original article [AINews] "Laguna S 2.1 Released: Cheaper than Deepseek v4 Flash, Better than V4 Pro" Inside the Model Factory — Eiso Kant, Poolside AI [AINews] AI Cybersecurity becomes top of mind