{"slug": "flux-3-action-tops-robolab-but-large-companies-can-t-use-it-in-a-product", "title": "Flux 3 Action Tops RoboLab, but Large Companies Can't Use It in a Product", "summary": "Black Forest Labs released FLUX 3 Action, a 7B open-weights model that predicts robot actions and future video frames, on 22 September, and it now tops NVIDIA's RoboLab leaderboard at 42.9% with its slower variant while the faster version scores 38.3%. The license permits commercial use only for companies under $5 million in annual revenue and bars using its outputs to train similar models, so larger firms can use it only for non-commercial research. Separately, Dream Machines reported that adding one hour of clean demonstrations to 21 hours of existing data raised success on a production π0.5 unboxing fine-tune from 76% to 90%, and that changing only the inference-time action-chunk blending lifted the original model to 93%.", "body_md": "## **FLUX 3 Action scores 42.9% on RoboLab, and its faster version scores 38.3%**\n\nBlack Forest Labs released [FLUX 3 Action](https://bfl.ai/models/flux-3-action) on 22 September. It is a 7B model that predicts robot actions and future video frames, and its [weights are open](https://huggingface.co/black-forest-labs/flux-3-action-droid).\n\nNVIDIA’s [RoboLab leaderboard](https://research.nvidia.com/labs/srl/projects/robolab/leaderboard.html) ranks it first at 42.9%. That score comes from the slower of its two main versions. The faster version, the one BFL says runs 1.34 to 2.28 times faster than π0.5, scores 38.3%. HiDream-O1-Embodied, Atomic-WAM, and OASIS all score higher.\n\nThe [license](https://huggingface.co/black-forest-labs/flux-3-action-base/blob/main/LICENSE.md) allows commercial use only by companies with under $5 million in annual revenue, affiliates included. Everyone else can use it only for non-commercial research. It also bars using the model’s outputs to train a similar model, so you cannot distill from it either.\n\n## **Correction**\n\nLast week I wrote that SolarWM’s staged checkpoints above the 33B base were not out. That was wrong. [All three stages](https://huggingface.co/junchaoh-cs/SolarWM-H3-33B) were published on 13 September. On 22 September, the authors replaced the Stage2 checkpoint, so if you downloaded it before then, download it again.\n\n## **Research**\n\n### **Figure, AgiBot and Light Origins report scaling laws, and only AgiBot’s tracks task success**\n\nThree companies published data-scaling results in the past two weeks. Each presents its result as evidence that more pretraining data keeps making robots better, but they measure different things. Figure’s [Helix 2.5](https://www.figure.ai/news/helix-2-5-zero-shot-30-home-generalization) reports that pretraining on its human-behavior dataset lifts zero-shot success in 30 unseen homes from 9% to 56%. Its scaling law, though, predicts training loss, not task success. AgiBot’s [GE-Act 2.0](https://www.agibot.com/article/231/detail/120.html) measures success against data. From 300 to 30,000 hours, zero-shot success rises from 17.1% to 44.1%, with no sign of leveling off. Light Origins’ [Light-O1](https://www.lightorigins.com/blog/light-o1) measures only offline prediction loss and pose error. Only AgiBot’s curve shows robots succeeding more often as the data grows. None of the three models is downloadable.\n\n### **GPT-6 Astra scores 22.48% or 35.67% on RoboDojo, depending on the harness**\n\nTwo papers ran OpenAI’s Astra on the RoboDojo benchmark this week. [RoboProbe](https://arxiv.org/abs/2609.24170) had it pick target positions for the gripper and got 22.48%. [RoboDawn](https://arxiv.org/abs/2609.22966) gave it simple move commands, allowed more of them, and got 35.67%. The two papers also disagree on whether one demonstration helps. Each team's connection of the model to the robot is worth 13 points.\n\n### **An hour of clean data beat twenty hours of volume on a production π0.5 fine-tune**\n\n[Dream Machines](https://dream-machines.eu/blog/pi05-fine-tuning) fine-tuned π0.5 on a real unboxing task for a German manufacturer and published the ablations. Adding one hour of clean demonstrations to 21 hours of existing data raised success from 76% to 90%. Changing only how the policy blends action chunks at inference raised the original model from 76% to 93%. Validation loss couldn't distinguish good checkpoints from bad ones. Each test is 40 rollouts, so gaps of a few points are noise.\n\n### **Six open policies sit within 1.58 points on LIBERO and 31 apart on paraphrased instructions**\n\n[IndustrialVLA-Bench](https://arxiv.org/abs/2609.25562) ran six public policies, including π0.5 and GR00T-N1.7, under one setup. They land within 1.58 points of each other on standard LIBERO and 31 points apart when the instructions are reworded. [RoboFollow](https://arxiv.org/abs/2609.25636) shows why. When a scene allows only one sensible task, policies ignore the instruction. Standard LIBERO scores no longer tell you which policy to pick.\n\n### **A world model trained on absolute actions collapses on the same motion written as deltas**\n\n[Karim and Chlon](https://arxiv.org/abs/2609.23252) trained a world model on absolute positions, then gave it the same motion written as position changes. Goal-reaching success fell from 53% to 15%, even though both formats carry the same information. Nothing raised an error.\n\n### **Protecting 41 more layers takes four-bit π0.5 from 7% to 70.5% success**\n\n[VLAQuantBench](https://arxiv.org/abs/2609.25376) tested four-bit quantization across several VLAs. On π0.5, keeping 41 more action-head layers at full precision lifts success from 7.0% to 70.5%. The recipe that helps π0.5 hurts π0, so tune quantization for each model.\n\n### **Eidon AI shut down and put 1,274 hours of egocentric video under CC-BY-4.0**\n\nEidon AI, an egocentric-data company, shut down and released [its whole corpus](https://huggingface.co/datasets/eidon-ai/tracker-pov): 1,274 hours of head-mounted video of household chores, with arm tracking. CC-BY-4.0 means you can train commercial models on it. It comes from only 27 people, which limits its variety.\n\n### **Quick hits**\n\n- **[MuJoCo 3.14.0](https://github.com/google-deepmind/mujoco/releases/tag/3.14.0)** — tendon force limits that were silently ignored now apply, so some models will behave differently after upgrading.\n- **[OpenArm in Isaac Lab](https://github.com/isaac-sim/IsaacLab/issues/7938)** — the hand and TCP links default to 1 kg each, against 0.127 kg and zero in the URDF.\n- **[Octo distillation](https://arxiv.org/abs/2609.23048)** — an eight-layer student matches the teacher on every offline metric and completes 0 of 72 real trials, against the teacher’s 40.\n- **[Astronex-World 1.0](https://huggingface.co/Astronex-Lab/Astronex-World)** — a 5B action-conditioned video world model with Apache-2.0 weights, within a point of a 22B model on WBench.\n- **[InstinctFlash](https://github.com/General-Instinct/InstinctFlash)** — a Jetson Thor serving runtime. Its 33.78x speedup includes running fewer sampling steps, which changes the model’s outputs.\n- **[LIBERO-VPro](https://arxiv.org/abs/2609.24350)** — a 196,000-episode robustness benchmark with an empty Hugging Face dataset.\n- **[Skild, Physical Self-Play](https://www.skild.ai/blogs/physical-self-play)** — a humanoid soccer policy trained against itself in simulation, then run on a robot. The post gives no score and names no robot.\n- **[RoboHarm](https://robocurve.org/roboharm/)** — five harmful instructions, 20 trials each. Claude Fable 5.1 refused 20 of 100, GPT-6 Astra 2 and MolmoAct2 none.\n\n## **Industry**\n\n### **Isaac ROS 5.0 removes NITROS, and zero-copy falls back to CPU without saying so**\n\n[Isaac ROS 5.0](https://nvidia-isaac-ros.github.io/v/release-5.0/releases/index.html) removes NITROS, so code that calls it directly needs to be rewritten. The new zero-copy path works only when both nodes share a host, a GPU, and a Linux user. Otherwise, data goes through the CPU with no warning. Check `get_backend_type()==\"cuda\"` in your launch tests before upgrading.\n\n### **Qualcomm is buying PickNik, and prices a 16 GB robotics board under the Orin Nano Super**\n\nQualcomm agreed to [acquire PickNik](https://www.therobotreport.com/qualcomm-acquires-picknik-robotics-keep-moveit-open-source/), which maintains MoveIt, and says it “intends” to keep MoveIt open source. Its Arduino [VENTUNO Q](https://store.arduino.cc/products/ventuno-q) board is on pre-order at €298.99 with 16 GB of memory. NVIDIA’s 8 GB Orin Nano Super kit costs $399.\n\n### **Mercedes will ship Wayve’s end-to-end driver within two years**\n\nMercedes signed a [production agreement](https://electrek.co/2026/09/22/mercedes-benz-wayve-ai-driver-production-agreement/) to put the Wayve AI Driver in future cars for driver assistance in cities and on highways. It is the third top-10 automaker to sign with Wayve, after Nissan and Stellantis.\n\n### **Also**\n\nAlphabet’s Intrinsic released its industrial robot software, [Intrinsic Core](https://www.intrinsic.ai/blog/posts/introducing-intrinsic-core), under Apache-2.0. Boston Dynamics opened a [permanent center](https://bostondynamics.com/news/boston-dynamics-opens-robotics-metaplant-application-center-to-train-humanoid-robots-for-manufacturing-tasks/) at Hyundai’s Georgia plant to collect Atlas training data. D-Robotics, which makes robot chips, [raised $400M](https://www.prnewswire.com/news-releases/d-robotics-completes-400-million-in-series-c-funding-driving-the-robotics-industry-into-a-boom-in-product-categories-302881297.html).\n\n## **Shipped, and Still Owed**\n\n- **[ABC-130k](https://huggingface.co/datasets/XDOF/ABC-130k) shows its files again** , still under Apache-2.0. You still have to fill in an access form on Hugging Face to download it.\n- **Unitree’s 102 G1 datasets carry no license on Hugging Face** , while its[UnifoLM-WLA README](https://github.com/unitreerobotics/unifolm-wla) says they are Apache-2.0.\n- **The pi0-FAST checkpoints behind last week’s lead are [public](https://github.com/Physical-Intelligence/openpi/issues/1047)** , so you can check the 25-point gap yourself.\n- **[LIBERO-CTRL](https://github.com/hiroki-oist/LIBERO-ctrl) and [ModAR](https://github.com/adamhung60/ModAR-code) released their code under MIT.** ModAR released no checkpoints.\n- **[XR-2](https://huggingface.co/datasets/challenge-2026/challenge_data) now has about 705 of its 1,500 claimed hours online.**\n- **[ZimaBlue](https://github.com/ZimaBlue-WAM/ZimaBlue) removed its plan to release six checkpoints.**\n\n## **Worth Watching**\n\n- IROS 2026 runs 27 September to 1 October in Pittsburgh. And we’ll be there too!\n- Agility holds an analyst and investor day on 6 October.\n- TrendForce’s September DRAM contract prices are due around 30 September.", "url": "https://wpnews.pro/news/flux-3-action-tops-robolab-but-large-companies-can-t-use-it-in-a-product", "canonical_source": "https://topicqueue.substack.com/p/flux-3-action-tops-robolab-but-larger", "published_at": "2026-09-24 20:07:13+00:00", "updated_at": "2026-09-24 20:30:08.086519+00:00", "lang": "en", "topics": ["robotics", "ai-research", "ai-products", "machine-learning", "large-language-models"], "entities": ["Black Forest Labs", "FLUX 3 Action", "NVIDIA", "RoboLab", "Dream Machines", "π0.5", "Figure", "AgiBot"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/flux-3-action-tops-robolab-but-large-companies-can-t-use-it-in-a-product", "markdown": "https://wpnews.pro/news/flux-3-action-tops-robolab-but-large-companies-can-t-use-it-in-a-product.md", "text": "https://wpnews.pro/news/flux-3-action-tops-robolab-but-large-companies-can-t-use-it-in-a-product.txt", "jsonld": "https://wpnews.pro/news/flux-3-action-tops-robolab-but-large-companies-can-t-use-it-in-a-product.jsonld"}}