[AINews] Black Forest Labs FLUX 3 - Multimodal Flow Models that beat Seedance 2.0, Gemini Omni and Grok Imagine, and FLUX-mimic video-action robotics model

Black Forest Labs launched FLUX 3 Video, a multimodal flow model that the company claims beats Seedance 2.0, Gemini Omni, and Grok Imagine, alongside the FLUX3-mimic robotics model. The release includes text-to-video, image-to-video, video-to-video, and audio generation capabilities, with an open-weights Dev version forthcoming. The company also announced The Stack v3, the largest open code dataset at 114 TB raw, 224M repositories, and roughly 5T deduplicated tokens.

AINews Black Forest Labs FLUX 3 - Multimodal Flow Models that beat Seedance 2.0, Gemini Omni and Grok Imagine, and FLUX-mimic video-action robotics model A HUGE win for BFL Thursdays are the heaviest days for AI releases, and even though OpenAI scored a victory over Anthropic in launching the new ChatGPT Voice https://x.com/OpenAI/status/2080378182469857576?s=20 consumer and OpenAI Presence https://openai.com/index/introducing-openai-presence/ enterprise and getting more impressions than Claude Voice https://x.com/claudeai/status/2080376094939603366 today a completely accidental coincidence in timing, we are sure , neither seem as monumental as BFL’s launch of FLUX 3 Video https://x.com/bfl ai/status/2080308988961554582 today: We last covered BFL in our very well received Anjney Midha podcast https://www.latent.space/p/anj : Most GenMedia people will remember the BFL homepage when they initially launched Flux 1 in 2024, hinting at video models next https://bfl.ai/ , with their logo in a forest. Well, 2 years later, it’s finally real: The blogpost https://bfl.ai/blog/flux-3 outlines Self Flow, covering ALL their modalities together with strong preference claims: “ Its core capabilities include the following all outputs come with native audio generation : Text-to-video generation. Image-to-video generation, either continuing from a starting frame “animation” or using images as visual references. Video-to-video generation from a reference clip, carrying central elements of a source video - for instance the same character - into a new scene or context. Generative video-audio continuation from input video and audio. Keyframe-to-video generation for controlled transitions between defined moments. Multilingual dialogue. A broad range of visual styles and aspect ratios, extending far beyond conventional cinematic output. Agentic chaining of individual clips into longer, multi-shot sequences. High style diversity -- FLUX 3 Video easily handles ranges of styles from candid camcorder footage to animation and cinematics. Strong typography generation and animated designs.” Some of the above are SOTA features from other frontier lab models, like we discussed in our Grok Imagine pod , so the community has very much been put on notice that there has now been independent, perhaps SOTA, reproduction of these capabilities, with an open weights Dev version on the way. As if this release wasn’t enough, the team also announced FLUX3-mimic , which proves that the FLUX 3 model is learning a sufficient world model capable of driving robots… … and predicting their impact in real factory settings… AI News for 7/22/2026-7/23/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews’ website lets you search all past issues. As a reminder, AINews is now a section of Latent Space . You can opt in/out of email frequencies AI Twitter Recap Open Code, Open Models, and the Policy Fault Line Around Distillation The Stack v3 is the day’s most consequential open-data release : @anton lozhkov https://x.com/anton lozhkov/status/2080254608639701222 announced The Stack v3 , now the largest open code dataset publicly released: 114 TB raw , 224M repositories , 44B files , 770 languages , and roughly 5T deduplicated/filtered tokens . Relative to v2, the filtered corpus jumps from ~ 550B to ~5T tokens , with especially large gains in C++ x15 , TypeScript x7.5 , Rust x7 , and Python x4.8 . The notable operational changes are that v3 ships contents inline rather than Software Heritage IDs, includes a fresh GitHub recrawl through Aug 2025, excludes restrictively licensed code, and offers both a ready-to-train split and a full bucket for custom dedup/filtering. Hugging Face researchers framed it explicitly as infrastructure for the next generation of open code models and cyber-defense tooling: see @LoubnaBenAllal1 https://x.com/LoubnaBenAllal1/status/2080265326818648471 , @lvwerra https://x.com/lvwerra/status/2080268415697047852 , and commentary from @eliebakouch https://x.com/eliebakouch/status/2080322879015584240 noting prior Stack versions were used in many disclosed code-model training mixtures. Distillation remains the live ideological fault line : several high-signal posts pushed back on attempts to sharply separate “internet-scale pretraining” from output-level distillation. @GergelyOrosz https://x.com/GergelyOrosz/status/2080278275109040226 compared model inspection via prompting to reverse-engineering a competitor’s product, while @SchmidhuberAI https://x.com/SchmidhuberAI/status/2080284349186900162 emphasized distillation’s long lineage. @Suhail https://x.com/Suhail/status/2080340893035618638 argued the practical response is not prohibition but stronger investment in open-weight domestic models , and @garrytan https://x.com/garrytan/status/2080345524620914897 put it more simply: open weights are strategically important. The subtext across these posts is that open datasets like The Stack v3 materially raise the floor for every lab that wants to build competitive code models without relying on closed ecosystems. Multimodal Frontier: FLUX 3, Robotics Transfer, and New Audio/TTS Systems Black Forest Labs’ FLUX 3 expands the multimodal frontier beyond image/video : @bfl ai https://x.com/bfl ai/status/2080308988961554582 launched FLUX 3 , a unified multimodal model spanning image, video, audio, and action prediction , with early access for FLUX 3 Video and an explicit claim that the same architecture can be extended toward robotics. Team members connected it back to the earlier Self-Flow research, including @hila chefer https://x.com/hila chefer/status/2080312631416574373 and @robrombach https://x.com/robrombach/status/2080311119122444494 . What matters technically is the unified training story: not a loose family of specialized generators, but one architecture intended to bridge media generation and control. mimic’s FLUX-mimic is a concrete robotics instantiation of that thesis : @mimicrobotics https://x.com/mimicrobotics/status/2080307032746336367 described FLUX-mimic as a Video-Action Model built on top of FLUX 3 , trained on robot and wearable data for general-purpose dexterity and deployable on a single on-prem GPU . Their central claim is that better video world modeling transfers directly into robot control quality and sample efficiency; they’re already testing with Audi . This dovetails with @GeneralistAI https://x.com/GeneralistAI/status/2080292438057373947 , whose GEN-1 now supports varied end effectors and can adapt when the “hand” changes mid-rollout, reinforcing the idea that embodiment-general policies may come from conditioning on morphology rather than specializing per manipulator. Audio saw two notable launches at opposite ends of the stack : @Alibaba Qwen https://x.com/Alibaba Qwen/status/2080270065547809133 introduced Qwen-Audio-3.0-TTS in Flash and Plus variants, with 16 languages , inline control tags like whisper / angry , natural-language style steering, noisy-reference robustness, and up to 3-minute one-pass generation; they also claimed the 1 spot on the Artificial Analysis TTS leaderboard. Separately, @HuggingApps https://x.com/HuggingApps/status/2080330151775072537 highlighted WordVoice TTS , a smaller model with per-word control over duration, loudness, pitch, and tone—interesting less as a leaderboard play than as a control-surface experiment for audio tooling. Agent Infrastructure: Harnesses, Dynamic Workflows, Programmatic Memory, and Benchmarks The center of gravity is shifting from prompts to harnesses : multiple tweets converged on the same engineering thesis. @unclebobmartin https://x.com/unclebobmartin/status/2080257779395154409 described an “extreme constraints” workflow where trust comes from tests, QA, mutation testing, and metrics , not manual code review. @ThePrimeagen https://x.com/ThePrimeagen/status/2080335544102359236 said he has become materially more positive on AI coding workflows, especially for large structural refactors . @TheTuringPost https://x.com/TheTuringPost/status/2080292890039972119 made the cleaner systems point: “graph engineering” is mostly old software architecture renamed, and most agents still do not need complex graphs unless workflows branch, verify, or require human approvals. Several concrete harness/orchestration releases stood out : @omarsar0 https://x.com/omarsar0/status/2080296884187652381 summarized the Harness Handbook paper, which maps runtime behaviors to source locations and improved planning win rates for coding agents while reducing planner token use. The same author also described dynamic workflows as a generalized abstraction over loops/graphs/router patterns that can support model councils, advisor-judge-executor setups, and multi-backend orchestration across Claude/Codex/Hermes/etc. @witcheer https://x.com/witcheer/status/2080263307483812109 shipped Hermes Profiles , effectively namespaced agent instances with separate memory, API keys, sessions, gateways, and export/import paths—pragmatic agent lifecycle infra rather than model novelty. @davidfowl https://x.com/davidfowl/status/2080323537294766405 also announced a new protocol underlying Microsoft’s VS Code agents app. Memory and coordination are getting more formalized : @dair ai https://x.com/dair ai/status/2080345957204697261 highlighted PRO-LONG , a “programmatic memory” approach that stores full structured interaction histories and queries them like a database, outperforming bespoke long-horizon memory harnesses on ARC-AGI-3 with fewer tokens. @omarsar0 https://x.com/omarsar0/status/2080340696842539204 and @kimmonismus https://x.com/kimmonismus/status/2080358121369739489 pointed to Offloop’s D1 dispatcher , a small model that decides which agent should speak next—or whether no agent should—addressing the familiar failure mode where multi-agent systems burn tokens by duplicating work. Benchmarking is also evolving toward moving targets : @ryanmart3n https://x.com/ryanmart3n/status/2080322620248281252 launched Frontier-Bench , an ongoing community benchmark meant to evolve with frontier agent work beyond coding, while @CAIS https://x.com/CAIS/status/2080344746699170214 released EnigmaEval , a harder reasoning benchmark where Claude Fable 5 and GPT-5.6 Sol lead and the hard set still only yields 10% for Fable 5. Together these reflect a broad dissatisfaction with static evals for fast-moving agent systems. OpenAI Product Rollouts, Agent UX, and the Hugging Face Incident Fallout The actual OpenAI release was product/UX, not GPT-6 : after heavy speculation around “Opus 5” and a larger model drop from accounts like @kimmonismus https://x.com/kimmonismus/status/2080287241885134963 and @theo https://x.com/theo/status/2080419731396551167 , OpenAI’s shipped updates were more incremental but still meaningful for agent workflows. @OpenAI https://x.com/OpenAI/status/2080378182469857576 rolled out ChatGPT Voice in the desktop app for Plus/Pro/Business/Edu/Enterprise, powered by GPT-Live , with the ability to control the computer and coordinate work across ChatGPT Work and Codex . @OpenAIDevs https://x.com/OpenAIDevs/status/2080390328880951299 added multi-folder Codex projects , and later Sites Analytics https://x.com/OpenAIDevs/status/2080383045472075856 for published sites. Reactions were mixed: some found voice-driven multi-threaded coordination a genuine UX shift @reach vb https://x.com/reach vb/status/2080385130145759575 , @whoiskatrin https://x.com/whoiskatrin/status/2080383603024785629 , while others thought the internal hype had implied something much larger @kimmonismus https://x.com/kimmonismus/status/2080382455240860066 . Health in ChatGPT is a more strategically important rollout than it may first appear : @OpenAI https://x.com/OpenAI/status/2080339982288568709 , @ChatGPTapp https://x.com/ChatGPTapp/status/2080340381028467190 , and @thekaransinghal https://x.com/thekaransinghal/status/2080343306731761927 announced U.S. rollout of Health in ChatGPT , allowing users to connect Apple Health and supported medical records. The notable implementation claims: connected health data receives additional encryption, is not used to train foundation models or target ads, and the feature builds on substantial physician review effort. This is less about a new model and more about a new high-trust application layer on top of existing model capability. The Hugging Face hacking incident continues to dominate safety discourse : @johnschulman2 https://x.com/johnschulman2/status/2080319844952822154 called for transcript release to understand whether the top-level agent knowingly pursued the hack or whether value drift emerged through subagents. @RyanGreenblatt https://x.com/RyanGreenblatt/status/2080348061726089220 , @jachiam0 https://x.com/jachiam0/status/2080356345312845889 , and @Thom Wolf https://x.com/Thom Wolf/status/2080343858022354975 pushed on broader lessons: internal AI-agent security differs from standard external threat models; offensive cyber-capable models may be especially vulnerable to adversarial reversal; and the irony is that the first public autonomous attack narrative featured a closed model attacking while open infrastructure became part of the defense response. Inference, Serving, and the New Efficiency Arms Race Etched’s scale-up is the clearest capital/infra announcement of the day : @Etched https://x.com/Etched/status/2080307393699987849 raised $300M Series C at a $10.3B valuation to accelerate inference-cluster production and opened an 80,000 sq ft / 10 MW facility near its office. The messaging is explicit: not training frontier models, but “run the world’s inference.” Supportive commentary from infra operators and investors suggests real interest in the chip-side inference specialization thesis, e.g. @willdepue https://x.com/willdepue/status/2080363509523853424 and @juberti https://x.com/juberti/status/2080334558109802623 . Model efficiency and serving architecture remain a battleground : @ArtificialAnlys https://x.com/ArtificialAnlys/status/2080360526534877537 noted that OpenAI’s GPT-5.6 Sol effort settings dominate much of the current token-efficiency Pareto frontier , while @CoreWeave https://x.com/CoreWeave/status/2080377158153707886 posted a provider-speed benchmark for MiniMax M3 with 357 output tok/s and low blended price. On the open-serving side, @vllm project https://x.com/vllm project/status/2080297896856186945 described trillion-scale agentic RL inference plumbing in prime-rl 0.6.0 on vLLM — FP8 , expert parallelism, prefill/decode disaggregation, KV offload, and routing—used to train GLM-5 on SWE tasks at 131k sequence length with sub-5-minute steps on 28 H200 nodes . That post is one of the more useful glimpses into how modern RL/agent training and serving stacks are being fused. Top Tweets by engagement ChatGPT Voice desktop rollout : @OpenAI https://x.com/OpenAI/status/2080378182469857576 shipped desktop voice control for ChatGPT Work and Codex, likely the biggest pure product launch by reach. OpenWorker : @AndrewYNg https://x.com/AndrewYNg/status/2080333504446108104 launched an open-source, model-agnostic local agent for files and workplace tools. Health in ChatGPT : @OpenAI https://x.com/OpenAI/status/2080339982288568709 / @ChatGPTapp https://x.com/ChatGPTapp/status/2080340381028467190 rolled out connected health context for U.S. users. FLUX 3 : @bfl ai https://x.com/bfl ai/status/2080308988961554582 launched a unified image/video/audio/action-prediction model with obvious downstream robotics implications. The Stack v3 : @anton lozhkov https://x.com/anton lozhkov/status/2080254608639701222 released the largest open code dataset yet, a foundational input to future code-model competition. AI Reddit Recap /r/LocalLlama + /r/localLLM Recap 1. Open-Weight AI Geopolitics and Government Deployment Activity: 2278 : Sanctions on Open Source. hope they don’t do anything stupid here. https://www.reddit.com/r/LocalLLaMA/comments/1v3v75j/sanctions on open source hope they dont do/ The image is a screenshot of an X post attributed to Treasury Secretary Scott B. warning that while the U.S. supports open-source AI, it may consider sanctions and Entity List designations if open-source releases enable alleged PRC “covert, industrial-scale distillation attacks” and theft of American IP Commenters are skeptical and sarcastic, suggesting such sanctions could “backfire” or be technically hard to justify. One commenter disputes the implied timeline by noting image https://i.redd.it/kkiaopjpwueh1.jpeg . In the Reddit context, the technical concern is whether model distillation from open or accessible frontier models could be treated as sanctionable IP theft, potentially chilling open-weight/model releases and downstream research. Fable5 released July 1 and Kimi K3 was announced July 15, implying that claiming a Fable-level distillation in 15 days would be implausibly fast.A commenter challenges the implied distillation/IP-theft timeline by noting Fable5 was released on July 1 , while Kimi K3 was announced on July 15 ; they argue that producing a comparable distilled model in only 15 days would be unusually fast, implying the accusation may be technically implausible without stronger evidence. Activity: 1030 : DeepSeek Founder’s 4-hour investor meeting: DeepSeek is prioritizing AGI over user growth and commercialisation https://www.reddit.com/r/LocalLLaMA/comments/1v49lxp/deepseek founders 4hour investor meeting deepseek/ A translated Chinese report of DeepSeek founder Liang Wenfeng’s reported 4-hour investor meeting says the lab is explicitly optimizing for AGI probability over near-term commercialization/user growth, treating products, hallucination mitigation, multimodality, and vertical agents as secondary to coding agents → continual learning → AI self-iteration → embodied intelligence. Liang reportedly committed that DeepSeek’s open-source releases are the same models it deploys internally, not degraded variants, and argued the China–US gap is mainly compute/resources rather than talent, while reaffirming belief in scaling: “larger scale undoubtedly produces better results.” Strategically, DeepSeek claims it will avoid super-app ambitions, video/3D/world-model work, and profit-maximizing API pricing, emphasizing low-cost architectures, open source, and team stability as mechanisms to improve its odds of reaching AGI. Commenters were mostly enthusiastic about the candor and open-source stance. One geopolitical take argued that if Chinese labs sustain an open-source AI strategy, US profit-driven labs like OpenAI / Anthropic may need either regulatory exclusion of Chinese models or a persistent technical lead large enough to offset rapid catch-up.A commenter questioned the core technical premise behind DeepSeek’s AGI prioritization: despite steady model improvements, they argue it remains unclear whether current LLM-style scaling and training approaches can actually lead to AGI, saying “AGI itself does not seem closer currently than it was before.” This frames the investor-meeting strategy as dependent on an unresolved research assumption rather than just execution or commercialization speed.One discussion point focused on the competitive implications of China-backed/open-source AI versus profit-driven U.S. labs. The commenter argued that if Chinese labs continue releasing strong open models, U.S. companies may need either regulatory exclusion of Chinese models or a sustained technical lead from OpenAI/Anthropic large enough that Chinese competitors remain ~1 year+ behind each generation. Activity: 592 : 🇦🇹 Austria is rolling out a government AI-platform using Mistral models and Open WebUI https://www.reddit.com/r/LocalLLaMA/comments/1v3hra4/austria is rolling out a government aiplatform/ The image https://i.redd.it/210mo4irjseh1.jpeg shows Austria’s GovGPT web UI labeled as an AI workspace for “Texte und Dokumente,” matching reports that the platform uses Open WebUI as the frontend and Mistral open-weight models on sovereign BRZ federal datacenter infrastructure. Per the post’s sources, the rollout targets roughly 180,000 Austrian federal employees, with use cases including free chat, document summarization, document Q&A, internal knowledge bases, electronic-file analysis, parliamentary requests, and later agentic workflows—making it a notable real-world public-sector deployment of open-weight LLMs. Comments were split between jokes and practical support: one technical commenter argued the system could be very useful if connected to government documents because LLMs perform well with retrieved context, while an Austrian commenter framed it as a strong proof-of-concept that can later swap in stronger or fine-tuned models.A commenter argued the platform’s main value will come from retrieval/context grounding rather than the base model’s parametric knowledge: if Austria indexes “all the government documents behind it,” an LLM could help citizens navigate procedures and forms more effectively than relying on training data alone.An Austrian commenter framed the rollout as a proof of concept for locally hostable/public-sector AI, noting that the backend could later be swapped for stronger or fine-tuned models. They emphasized that even a “modest model” may yield productivity gains in administration because many tasks are repetitive, document-heavy, and procedural.One technical objection questioned the model choice, claiming Mistral Medium 3.5 is only “on par” with alternatives such as Gemma 4 31B and Qwen 3.6 27B , implying Austria may have chosen Mistral for reasons other than raw benchmark competitiveness. Activity: 542 : China’s Kimi K3 fuels fears safety curbs are holding back US AI https://www.reddit.com/r/LocalLLaMA/comments/1v3us2p/chinas kimi k3 fuels fears safety curbs are/ SCMP reports https://www.scmp.com/tech/tech-trends/article/3361358/chinas-kimi-k3-fuels-fears-safety-curbs-are-holding-back-us-ai that Moonshot AI’s open-weight Kimi K3 is a 2.8T -parameter model that found 23/26 recent vulnerabilities on Aikido Security’s private cybersecurity benchmark, matching OpenAI GPT-5.6 Terra and nearing GPT-5.6 Sol, while being substantially cheaper. The post frames this as evidence that US frontier labs’ cyber-safety guardrails, refusals, and API-only access may reduce usefulness for defensive vulnerability analysis and patching compared with Chinese open-weight systems from DeepSeek, Qwen, Kimi, and GLM. Commenters argued that US AI competitiveness is being hurt less by raw capability limits than by over-regulation, closed APIs, high pricing, and exclusivity , while Chinese labs benefit from open-weight sharing driven partly by chip sanctions. Several compared the dynamic to Chinese EVs: US restrictions may isolate domestic users while the rest of the world adopts cheaper, more open Chinese technology.Several commenters argued that US frontier labs’ closed API strategy may be pushing developers toward Chinese open-weight ecosystems such as DeepSeek, Qwen, Kimi, and GLM . One technical claim was that chip sanctions forced Chinese labs to collaborate by sharing weights, research, and optimization techniques , whereas US labs increasingly rely on proprietary APIs and heavier compliance layers.A concrete usability complaint cited safety filtering interfering with programming workflows: one user claimed “Fable looks at C code and hard NOs it every time,” suggesting that safety classifiers may over-refuse low-level systems code such as C , which can overlap with exploit or malware domains but is also common in legitimate development. 2. Distillation Accusations vs Synthetic Data Activity: 2088 : Absurd claim: the distilled model outperforms the originals https://www.reddit.com/r/LocalLLaMA/comments/1v49zi9/absurd claim the distilled model outperforms the/ The image is a leaderboard-style benchmark chart for “Frontend Code Arena” claiming Kimi-K3 ranks 1 with a score of 1,679 , ahead of alleged frontier models such as Claude Fable 5 1,631 and GPT-5.6 Sol 1,599 Comments do not add much technical evidence; they mostly frame the issue as geopolitical/policy motivated, e.g. arguing that complaints about China “playing fair” are hypocritical or that bans are being pushed because competitors “can’t beat them.” image https://i.redd.it/fgrrhpiaiyeh1.jpeg . The post argues this is being used to support an “absurd” policy narrative: that a supposedly distilled Chinese model could outperform its source/original models, which the author disputes on both timeline feasibility and the limits of distillation.A commenter challenged the premise that a distilled model cannot outperform its source, arguing that post-training methods such as RL can shift model behavior toward preferred responses without changing the base pretraining distribution. The implication is that “distilled” performance comparisons are not straightforward: a student model may combine its own pretraining, RLHF/RLAIF, synthetic data, and teacher-derived signals in ways that outperform the teacher on some evaluations. One technically substantive thread distinguished between “Kimi used no distillation” and “Kimi used some distillation, but that does not make it a clone.” The commenter argued that observed output similarity to Anthropic models would be statistically unlikely without some teacher-model influence, while noting that distillation can happen at many stages and intensities, from synthetic-data augmentation to targeted post-training.A commenter criticized using a blind human-preference benchmark as evidence that Kimi is more capable than its alleged teacher model. They noted that such benchmarks measure preference over sampled outputs, not necessarily underlying intelligence, reasoning robustness, or benchmark-general capability, so a distilled model outperforming on that leaderboard would not rule out distillation. Activity: 529 : Model “distillation” accusations are getting way overblown at this point https://www.reddit.com/r/LocalLLaMA/comments/1v47kp4/model distillation accusations are getting way/ The image https://i.redd.it/vvybtho5uxeh1.jpeg is a non-technical news-style screenshot claiming Anthropic will pay $1.5B to authors over allegations that copyrighted books were used to train Claude; the post uses it as context for a broader argument that teams should reduce dependence on closed AI APIs due to pricing, compliance/IP exposure, data leakage, and vendor lock-in. The author argues that “distillation” accusations are being semantically stretched: true model distillation typically involves learning from teacher logits, while Claude-style generated outputs are better described as synthetic training-data generation, especially since closed APIs do not expose logits. Commenters focused less on distillation and more on compensation and scraping impact, with one noting $214/book seems cheap and another alleging Anthropic crawlers effectively DDoS’d their website. A self-identified class-action plaintiff said their payout exceeds the quoted $250 and is roughly equivalent to a year of royalties for two allegedly downloaded books.A commenter reports that Anthropic’s crawlers allegedly hit their website hard enough to resemble a DDoS , raising a concrete operational concern around AI training-data collection: crawler rate limits, robots.txt compliance, and infrastructure costs imposed on site operators.One plaintiff in the Authors Guild class action says their expected payout exceeds the $250 figure discussed and is roughly equivalent to a year of royalties on two books allegedly downloaded by Anthropic , providing a real-world data point on compensation scale in AI training-data litigation.A commenter notes the topic had already been discussed with a primary article link rather than a Twitter screenshot, pointing to an earlier LocalLLaMA thread: Anthropic claims local models are stealing from… https://www.reddit.com/r/LocalLLaMA/comments/1v2ky1e/anthropic claims local models are stealing from/ . Activity: 441 : Model “distillation” accusations are getting way overblown at this point https://www.reddit.com/r/LocalLLaMA/comments/1v44aa6/model distillation accusations are getting way/ The post argues that many claims that strong open models are “distilled from GPT-4/Claude” conflate true token-level knowledge distillation—which requires access to teacher logits/full vocabulary probability distributions—with synthetic-data fine-tuning from public API text completions. It notes that API outputs are often filtered by guardrails/routing layers e.g. control-plane-style moderation such as Top comments mostly agree that the distinction is technically valid but irrelevant to public discourse: once the discussion involves terms like Lyzr Control Plane https://www.lyzr.ai/ , so strong performance in restricted technical domains is not well-explained by naive scraping of guardrailed completions; model self-identification as “GPT” or “Claude” is framed as weak evidence of data contamination rather than proof of competitor-model distillation. logits , most non-technical audiences disengage, while technical readers already understand the marketing/legal ambiguity. Other comments frame the controversy as emotionally or politically driven rather than evidence-driven, with one dismissing the premise by joking that no one would be distilling GPT-4 in “summer 2026.”Several commenters argued that the public accusations hinge on technical concepts like logits and what actually qualifies as model distillation, but that nuance is lost outside technically literate communities like LocalLLaMA. The implied technical distinction is that evidence of reuse would require more than vague behavioral similarity or marketing claims; most nontechnical audiences cannot evaluate whether a model was trained from another model’s outputs, logits, or synthetic data.One comment claimed that accusations against Chinese labs ignore the volume of open papers, model releases, and independent iteration coming from China, while also noting that most people lack a concrete understanding of the compute/data/process required to distill a frontier model. The technical point is that credible distillation claims would need to account for feasibility and methodology rather than just assume capability transfer from a closed model. 3. Browser Agents and Weight-Editing Research Activity: 479 : microsoft/Fara1.5-27B · Hugging Face https://www.reddit.com/r/LocalLLaMA/comments/1v3ny84/microsoftfara1527b hugging face/ Microsoft Research AI Frontiers released microsoft/Fara1.5-27B , a vision-only multimodal computer-use agent for browsers that consumes screenshots plus textual trajectory history and emits structured actions such as click , type , scroll , visit url , and web search with grounded arguments like pixel coordinates. It is supervised fine-tuned from Qwen3.5-27B using synthetic task/trajectory data from FaraGen1.5, is intended to run with MagenticLite, and has smaller companion checkpoints Fara1.5-4B and Fara1.5-9B . Key limitations called out are lack of DOM/accessibility-tree perception, English-only training, susceptibility to visual prompt injection/UI ambiguity, multi-step error compounding, non-trivial run-to-run variance, and hallucinated/misattributed page state. Commenters questioned the choice to fine-tune from a Chinese Qwen-family base model — specifically noting “Qwen3.5-27B” — and asked why Microsoft did not use DOM, accessibility-tree, or OCR inputs. One technical read of the paper suggested the vision-only design may be partly due to token-budget constraints, with even URL metadata reportedly being length-trimmed.Commenters noted that Fara1.5-27B appears to be fine-tuned from a Qwen 27B base model, prompting discussion about Microsoft relying on Alibaba/Qwen-family models rather than an in-house MAI small “computer use” foundation model.A technically focused question asked why the model apparently does not use richer computer-use signals such as DOM trees, accessibility APIs, or OCR . One commenter inferred from the paper that the design may be token-budget constrained , noting that even useful metadata like URLs are acknowledged but aggressively trimmed in length. Activity: 315 : I hand-wrote facts directly into Llama-3.1-8B’s weights — no fine-tuning, no LoRA, no RAG. Also built, a cool visualizer here’s a live map of where each fact physically lives. https://www.reddit.com/r/LocalLLM/comments/1v40sl5/i handwrote facts directly into llama318bs/ The post presents a mechanistic-interpretability-style method for “baking” explicit facts into Llama-3.1-8B by appending/using a measured MLP region with hand-constructed neuron circuits rather than fine-tuning, LoRA, or RAG, claiming the base weights are untouched and validated via known-fact recall plus LM loss checks. The author demoed an interactive neuron visualizer and baking service at albertmi.ai https://albertmi.ai/ and a model containing 502 Wikipedia facts; each fact is described as having localized components—“code key” near layer 6 , readout near layer 25 , chain neurons, and late-layer rescue—whose ablation removes the fact. A paper is linked via Zenodo: Top commenters focused on validation and side effects: whether unrelated QA or distributional behavior degrades, whether encoded answers become spuriously more likely, and whether this could serve as a persistent memory mechanism where a smaller model decides what to store and bakes facts into itself. doi:10.5281/zenodo.21502811 https://doi.org/10.5281/zenodo.21502811 .Several commenters focused on whether direct weight editing causes catastrophic side effects outside the inserted facts: degradation on unrelated prompts, increased likelihood of emitting one of the encoded answers for unrelated questions, or interference with existing knowledge. The key technical concern is whether the method preserves the model’s original distribution or introduces localized overfitting/activation attractors.A technically substantive thread compared the approach to a possible persistent memory system : instead of LoRA, fine-tuning, or RAG, a smaller model could decide which facts are worth retaining and then permanently encode them into its own weights. The unresolved implementation issue is how to automate fact selection and insertion while preventing model corruption or accumulation of stale/incorrect memories.One commenter connected the work to activation/representation steering , asking why “active steering” has not become more central for inducing internal model states or persistent behavioral changes in current LLMs. Another noted that if the process produces a modified model artifact, it strengthens the need for checksum verification to detect tampered or silently edited weights. Less Technical AI Subreddit Recap /r/Singularity, /r/Oobabooga, /r/MachineLearning, /r/OpenAI, /r/ClaudeAI, /r/StableDiffusion, /r/ChatGPT, /r/ChatGPTCoding, /r/aivideo, /r/aivideo 1. Kimi K3 Distillation and Sanctions Claims Keep reading with a 7-day free trial Subscribe to Latent.Space to keep reading this post and get 7 days of free access to the full post archives.