Black Forest Labs 發布 FLUX 3 Action:70億參數開源權重世界動作模型,躍居 RoboLab-120 榜首
Black Forest Labs (BFL), the lab behind the FLUX image models, has released FLUX 3 Action.It is a 7B open-weights World Action Model (WAM) for robot control.The model reads camera frames, robot state and a text instruction.It then predicts future video frames and the next chunk of actions together.
On the RoboLab-120 leaderboard, it ranks first at 42.92% task success.Is it deployable?Yes, with conditions.The DROID policy needs about 32 GB of GPU memory in BF16 on an H200.It fits 24 GB cards with FP8 quantization and text encoder offload.The FLUX Kommunity License allows non-commercial use.
The Trade-off FLUX 3 Action Targets Open robot policies usually force a choice.WAMs like NVIDIA’s Cosmos 3 Nano lead RoboLab at 36.8%, but predicting video is expensive.VLAs like π0.5 are fast, but reach only 28.0%.On a B200, BFL measured that Cosmos 3 Nano (FP8) needs about 4.
7x more processing time than π0.5 (BF16) per second of robot motion.FLUX 3 Action keeps joint video and action prediction.BFL closes the speed gap with a smaller backbone and distillation instead.Architecture and Training FLUX 3 Action is derived from the multimodal FLUX 3 backbone.
Pretraining used image, video and audio data, and video made up over 95% of training tokens.Text, video and robot state are encoded into tokens.The backbone’s future tokens are decoded into video frames, and its action tokens into robot actions.Midtraining mixed pretraining data (36.
95% of samples) with action-aligned video (63.05%).The action data covered game recordings, egocentric human hand video, handheld grippers and teleoperation across 14 embodiments.Most robot data uses a shared 50-dimension end-effector action space called EE50.Pretraining matters a lot here.
Without it, DROID-only training stayed below 1% on RoboLab.With pretraining, the same protocol reached 11.6%.Benchmark Results RoboLab-120 has 120 tabletop tasks in Isaac Sim, with 10 trials each on a DROID-style Franka setup.ModelTypeParamsRoboLab-120FLUX 3 ActionWAM7B42.
92%Cosmos3-Nano-PolicyWAM16B36.8%π0.5VLA3.3B28.0%DreamZeroWAM14B25.7%GR00T N1.6VLA3B7.2% That is a 6.1 percentage point lead with 56% fewer parameters than Cosmos 3 Nano.The 42.92% figure is the leaderboard entry.BFL’s multi-seed mean for the guidance-distilled FP8 checkpoint is 42.24% ± 0.36.
Real hardware results follow the same pattern.Positronic Robotics ran a blind evaluation on a Franka arm with 10 DROID tasks and 3 attempts each.FLUX 3 Action completed 28 of 30 attempts (93.3%).Cosmos 3 Nano scored 27/30, DreamZero 20/30 and π0.5 13/30.
3 Checkpoints, 3 Speed Points BFL ships the DROID policy in 3 recipes, each in BF16 and FP8: Base: 4 sampling steps with split guidance (video CFG 4, action CFG 1).Guidance-distilled: drops the second guidance pass, runs 1.8x to 2x faster and scores 0.6 to 1.08 pp higher.
Step-distilled: 1 sampling step, 3.15x to 4x faster, with a 3.51 to 4.32 pp drop in success.Against Cosmos 3 Nano in FP8, the base and guidance-distilled checkpoints run 1.52x to 3.95x faster across consumer, workstation and datacenter GPUs.Each call yields 32 actions at 15 Hz, or 2.
13 seconds of motion.π0.5 yields 1.0 second per call.So BFL reports speed as real-time factor, not per-call latency.In FP8, the step-distilled checkpoint beats π0.5 by 1.34x to 2.28x on workstation and datacenter GPUs.On an RTX 5090, it is slower than π0.5.(function(){ var f=document.
getElementById('mtp-f3a-frame'); window.addEventListener('message',function(e){ if(!f||e.source!==f.contentWindow||!e.data||!e.data.f3aHeight)return; f.style.height=e.data.
f3aHeight+'px'; }); })(); Pairing a Fast Policy With a Reasoner BFL also tested hybrid control with GPT 6 Astra, following the Su et al.(2026) setup.The reasoner can execute, edit or replace the policy’s predicted actions.
With FLUX 3 Action and low reasoning effort, the hybrid solved 90% of episodes at $8.77 and 8m 08s per success.Pure Astra at maximum effort solved 100%, but cost $13.47 and 16m 23s per success.Fine-Tuning, LeRobot and Jetson AI teams can fine-tune FLUX 3 Action on their own demonstrations.
BFL published a DROID recipe and an SO-101 LoRA recipe.Its docs show an SO-101 pick-and-place skill learned from about 200 demonstrations.With NVIDIA, BFL integrated the model natively into Hugging Face LeRobot, and it supports edge deployment on NVIDIA Jetson.
The docs also include game-playing and simulated drone examples.Copy CodeCopiedUse a different Browserfrom lerobot.policies.flux3 import Flux3Policy from lerobot.policies.factory import makeprepostprocessors repoid = "black-forest-labs/flux-3-action-droid" policy = Flux3Policy.
frompretrained(repoid) preprocessor, postprocessor = makeprepostprocessors(policy.config, pretrainedpath=repo_id) The model outputs joint targets with no built-in velocity, force or workspace limits.Your application must enforce those limits.Key Takeaways 7B WAM ranks first on RoboLab-120 at 42.92%.
Leads Cosmos 3 Nano by 6.1 pp with 56% fewer parameters.Up to 3.95x faster than Cosmos 3 Nano in FP8.Plans 2.13s of motion per call versus 1.0s for π0.5.Weights, code and recipes ship under the FLUX Kommunity License.Check out the full technical report, model weights, GitHub repo and docs.
All credit goes to the researcher of this project.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?now you can join us on telegram as well.
Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?Connect with us The post Black Forest Labs Releases FLUX 3 Action: A 7B Open-Weights World Action Model That Tops RoboLab-120 appeared first on MarkTechPost.
Related
相關文章
Liquid AI 推出 LFM2.5-VL-3B-DSpark:推測解碼加速視覺語言模型,最高提升 3.13 倍
Liquid AI 發布 LFM2.5-VL-3B-DSpark,這是針對其 LFM2.5-VL-3B 視覺語言模型所設計的實驗性推測解碼草稿模型。該草稿模型約增加 2.8 億個參數,在不改變模型輸出的前提下加快解碼速度。官方數據顯示,在 Apple 晶片上解碼速度最高提升 3.13 倍,在 NVIDIA H100 上則最高提升 2.66 倍。此模型已可部署,權重以 Safetensors 與 GGUF 格式發布於 Hugging Face,並支援 SGLang、MLX-VLM 與 llama.cpp。Liquid AI 團隊將其標註為實驗性版本,採用 LFM 開放授權 v1.0,僅允許年營收低於 1000 萬美元的公司免費商用。推測解碼的原理是:標準模型每次前向傳播僅生成一個 token,而此技術加入一個小型草擬模型,以加速整個生成流程。

德國柏林警方藉助人工智能監控攝像頭打擊犯罪,自動識別暴力和破壞行為
作者:浩渺 責編:浩渺 評論: 9 月 25 日消息,據央視新聞報道,德國柏林警方 24 日在一處犯罪高發區域啟動一項計劃,將藉助人工智能監控攝像頭打擊犯罪。據悉,柏林警方將在這項計劃啟動的前四周內,在科特布斯門地區安裝並調試好人工智能監控攝像頭,隨後正式投入使用。

別人忙著卷Code,Kimi抽身反打瀏覽器插件:網頁操作一秒變Skill
Kimi近日推出瀏覽器擴展,由先前的WebBridge升級而來,新增側邊欄直接對話及將網頁操作錄製成Skill以便複用的功能。該擴展可操控真實瀏覽器完成重複性任務,但官方提醒複雜頁面可能導致操作失敗。此舉與Kimi Code Desktop搭配,顯示其強化Agent在桌面端與瀏覽器之間協作的產品策略。

影石正佈局 AI 眼鏡,或採用“分體電池”設計
首頁 IT圈 最會買 設置 日夜間 隨系統 淺色 深色 主題色 黑色 投稿 訂閱 RSS訂閱 收藏 軟媒應用 App客戶端 要知App 軟媒魔方 業界 手機 電腦 測評 視頻 AI 蘋果 iPhone 鴻蒙 軟件 智車 數碼 學院 遊戲 直播 5G 微軟 Win10 Win11 專題 搜索 首頁 > 智能時代>智能穿戴 影石正佈局 AI 眼鏡,或採用“分體電池”設計 2026/9/25 12:26:17 來源:新浪科技 作者:- 責編:沁滄 評論: 9 月 25 日中午消息,有接近影石創新人士透露,當前影石創新正在佈局 AI 眼鏡賽道,並在進行相關研發,未來或將推出自己的 AI 眼鏡產品。

DeepSeek Harness 官方桌面版預覽偷跑
作者:故淵 責編:故淵 評論: 感謝網友 Domado、陣雨、章魚小丸子、科文雨、億百盧閃蔥、Juliandu、Vincent89、南琴梨 的線索投遞!9 月 25 日消息,DeepSeek Harness 悄然上線官方桌面版,目前還是開發者預覽版,版本號為 V0.

【IT之家開箱】小米 Watch S5 41mm 智能手錶圖賞:瑩白陶瓷表圈 + 24 道精雕錶冠,主打精緻佩戴
作者:馬卡 責編:馬卡 評論: 9 月 25 日消息,在 9 月 23 日晚間舉行的小米秋季新品發佈會上,小米 Watch S5 41mm 智能手錶正式發佈,首發搭載表端澎湃 OS 4,並升級了表端微信 App,售價 1299 元起。小米 Watch S5 41mm 提供氟橡膠錶帶款和真皮錶帶款,售價分別為 1299 元和 1499 元。