Cloudflare 推出 Clef-omni:30B-A3B 多模態決策模型,支援音訊、影片、影像與文字
Cloudflare has released Clef-omni, a new open-weight member of its Clef decision model family.Clef-omni is a Cloudflare decision model that scores text, images, audio and video in 1 call.It arrived on October 9, 2026, 8 days after the original Clef and Clef-flash launch.
The same update cut Clef-flash pricing below TypeSafe’s Jev and made hosted Clef roughly 2x faster.For developers, this removes the transcription and captioning steps that multimodal agent pipelines usually need.
TL;DR Size: 30B total, 3B active parameters (MoE); 64,000-token context on Workers AI Runs on: Workers AI as @cf/cloudflare/clef-omni; self-hosting tested on a single H200, about 64 GB GPU memory in bfloat16 Performance: Close to Clef on routing and intent tasks, behind it on most reasoning and workflow evals Best: 97.
7 macro-F1 on CLINC150+OOS, top of the 4 Clef and Jev models Worst: 2.6 accuracy on POP909-CL, and 47.4 on GPQA Diamond versus Jev’s 78.3 Bottom line: Best: one call decides across 4 modalities.Worst: weaker accuracy than text-focused Clef on hard reasoning.What is a decision model?
A decision model returns typed answers with probabilities instead of generated text.You send a state and a schema of questions.The model returns a probability for every allowed option.Clef supports 3 question types: noul (true or false), choice and score.
The format follows the Jev and SystemOne API from TypeSafe AI.How does Clef-omni work?Clef-omni is post-trained from Qwen3-Omni-30B-A3B-Instruct.Cloudflare keeps the comprehension backbone and drops the text-to-speech output path.The model runs a single prefill pass over the full payload.
Video frames and audio are synced into 1 sequence for joint processing.A small joint schema head then scores the options.Each valid option first gathers evidence from the input.Field vectors then cross-attend across the full context to compute confidence scores.
Cloudflare froze the Qwen3 backbone and trained LoRA adapters.Training combined label-smoothed cross-entropy with Brier score calibration.
Supported inputs on Workers AI, per the developer docs: Images: up to 4, PNG, JPEG or WebP, 64 to 1,024 tokens each Audio: up to 4 clips, WAV or MP3, 300 seconds each, about 780 tokens per minute Video: up to 2 clips, MP4 or WebM, 60 seconds each, sampled at 2 frames per second Questions: 1 to 64 per request Cloudflare reports text decisions in about 130 ms at the median and images in about 150 ms.
A 21-second video with sound scores in about 1.5 seconds.How does Clef-omni perform on benchmarks?Cloudflare compared Clef-omni against Clef, Clef-flash and Jev on its Decision Index run.Clef-omni leads on intent classification: 94.8 macro-F1 on BANKING77 and 97.7 on CLINC150+OOS.
It also tops Amazon ESCI at 57.8.It trails elsewhere.Home appliances case-exact accuracy is 69.3, versus 97.73 for Clef-flash.When2Call accuracy is 63.3, versus 80.97 for Jev.On TypeSafe’s workflow evals, Clef-omni scores below Clef in all 5 reported metrics.(function(){window.
addEventListener("message",function(e){var d=e.data;if(d&&d.mtpFrame==="clefomni"&&d.h){var f=document.getElementById("mtp-clefomni-frame");if(f)f.style.height=d.
h+"px";}});})(); Clef-omni vs Clef vs Clef-flash vs Jev FeatureClef-omniClefClef-flashJevDeveloperCloudflareCloudflareCloudflareTypeSafe AIParameters30B total, 3B active (MoE)27B dense9B denseNot disclosedBase modelQwen3-Omni-30B-A3B-InstructQwen3.8-27BQwen3.
5-9BNot disclosedInputsText, image, audio, videoText, image, video framesText, image, video framesText (per Cloudflare)Hosted context64,000 tokens64k24k (256k self-hosted)Not disclosed by TypeSafe (Cloudflare cites 32k)Input price per M tokens$0.15$0.24$0.038$0.042LicenseApache-2.0Apache-2.
0Apache-2.0API only, early accessBANKING77 (macro-F1)94.894.2090.9379.74CLINC150+OOS (macro-F1)97.797.4366.7789.27When2Call (accuracy)63.372.3765.5880.97BRIGHT (nDCG@10)42.045.9139.2647.52Invoice processing, primary action82.086.273.383.
1 Benchmark scores are from Cloudflare’s announcement and were not independently verified.How much faster is Clef?Cloudflare moved hosted Clef to SGLang and tuned its serving stack.No new weights were released.Median latency fell from 262 ms to 152 ms at about 800 tokens, a 1.7x gain.
At about 3,400 tokens it fell from 616 ms to 305 ms, a 2.0x gain.At about 16,000 tokens it dropped from 2,721 ms to 1,635 ms.Clef support lands in SGLang 0.5.22.Key Takeaways Clef-omni scores text, images, audio and video in 1 decision call.It is a 30B-A3B MoE on Qwen3-Omni, Apache-2.0, at $0.
15 per million tokens.Clef-flash now costs $0.038, under Jev’s $0.042, with 24k hosted context.Hosted Clef is 1.7x to 2.0x faster at the median after moving to SGLang.Clef-omni wins intent tasks but trails Clef on reasoning and workflow evals.
Check out the Cloudflare announcement, model weights and Workers AI docs.All credit goes to the researcher of this project.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?
now you can join us on telegram as well.The post Meet Cloudflare Clef-omni: A 30B-A3B Multimodal Decision Model for Audio, Video, Image and Text appeared first on MarkTechPost.
Related
相關文章
認識 Voxel51 3.0:為實體 AI 打造的統一多模態資料平臺
Voxel51 已發布 Voxel51 3.0,這是其資料平臺的一次重大更新。Voxel51 3.0 是一個端對端的多模態資料平臺,將搜尋、篩選、標註和評估整合於單一系統中。該平臺鎖定針對機器人、車輛和工廠感測器資料進行模型訓練的團隊。此次發布新增了 Voxel51 Agent、資料溯源層及免費的自助式存取。重點摘要:規模:Voxel51 Agent 內建超過 45 個 MCP 工具、80 多個運算子及 18 個開源技能。執行環境:可於 app.voxel51.com 使用託管網頁應用程式,或於雲端、混合、地端及隔離環境中自行部署。未揭露本機 GPU 需求。效能:未發布產品基準測試。Voxel51 引用其自身調查數據作為依據。最佳亮點:免費方案包含 Voxel51 Agent、每月 30,000 次推論請求及 30 個運算小時。
本期AI資訊彙總2026年10月18日的產品更新、前沿研究、行業趨勢與開源項目,幫助讀者快速瞭解當天的重要動態
導航SecureDoc // EncryptionActive本期AI資訊彙總2026年10月18日的產品更新、前沿研究、行業趨勢與開源項目,幫助讀者快速瞭解當天的重要動態。
下一概念建模把文本生成提速最高31倍
斯坦福等聯合提出全新文本生成範式 NCM,生成速度狂飆 31 倍AIbase基地發佈於AI新聞資訊 · 1 分鐘閱讀 · Oct 16, 202633人工智能領域的文本生成技術迎來顛覆性創新。斯坦福大學與 Together AI 的研究人員近日聯手推出了一種截然不同於傳統自迴歸和擴散模型的全新文本生成範式——Next-Concept Modeling(簡稱 NCM,即“下一概念建模”)。該方法巧妙借鑑了圖像生成領域中“下一尺度預測”的思路,有望為未來的文本生成技術開闢全新的發展路線。在技術實現路徑上,NCM 模擬了人類“先構思宏觀大綱、再動筆填充細節”的寫作邏輯。整個系統通過兩階段訓練來完成:首先訓練多尺度殘差 VQ-VAE,從而得到能夠逐層補充信息的多層離散文本編碼;隨後凍結該系統,訓練 Transformer 模塊去預測下一層的編碼。在生成文本時,模型會先並行生成概念層面的宏觀大綱,接著逐層並行填充具體細節,最終組合成完整的文本內容。在實際測試表現中,NCM 交出了令人矚目的成績單。實驗數據顯示,在保持相近甚至更優生成質量的前提下,NCM 相對傳統的擴散語言模型實現了10到31倍的生成速度飛躍,並且在訓練過程中所需消耗的 token 數量也大幅減少。此外,在數獨等複雜推理任務上,它的表現也明顯優於傳統的自迴歸和擴散基線模型,同時還支持通過多生成候選挑選機制來進一步優化最終輸出效果。儘管目前該研究所使用的模型參數規模依然相對有限,其在擴大模型規模後的表現、精確文本以及長篇內容的生成能力仍有待後續驗證,但這一創新思路無疑打破了長期以來的技術慣性,為人工智能高效生成文本提供了充滿想象力的全新解法。本文來自AIbase日報掃碼查看歡迎來到【AI日報】欄目!這裡是你每天探索人工智能世界的指南,每天我們為你呈現AI領域的熱點內容,聚焦開發者,助你洞悉技術趨勢、瞭解創新AI產品應用。
Claude自主優化八類量子電路設計
ScienceDesigning more efficient quantum circuits with ClaudeOct 16, 2026Quantum computers will need carefully designed circuits to run useful algorithms on limited hardware.
12.88萬起、華為電驅+L4同源智駕,Ray7能成為埃安年輕化的答卷嗎?
12.88萬起、華為電驅+L4同源智駕,Ray7能成為埃安年輕化的答卷嗎? 本文作者: 倪萍 2026-10-17 22:42 導語:10月17日,埃安轎跑Ray7正式開啟預售,預售價12.88 萬起。新車車長4.9米,軸距2.9米,車頭部分搭配3.25米的超長雙環燈帶,是埃安10年煥新的家族 10月17日,埃安轎跑Ray7正式開啟預售,預售價12.88 萬起。新車車長4.9米,軸距2.9米,車頭部分搭配3.25米的超長雙環燈帶,是埃安10年煥新的家族式標識。 新車採用寧德時代電池以及廣汽自研的彈匣電池2.0技術,能夠在充分釋放續航能力的同時,監控電池健康狀態。提供45.58kWh和62.98kWh兩種規格,續航可達702公里,整車風阻係數 Cd 低至 0.22。Ray7搭載華為DriveONE多合一電驅,以及華為DriveONE芯片級驅制融合架構,百公里制動僅為32.8米。底盤方面,Ray7搭載高性能前後穩定杆和後五連桿懸架,過彎極限更高,濾振更乾淨。智能化上, Ray7搭載27顆車規級全視角傳感器,採用文遠知行L4級Robotaxi同源大模型。這幫助新車能夠複用 L4 積累的海量場景經驗,在城區掉頭、繞行等複雜場景中可順利通行。自2025年廣汽推進“番禺行動”以來,昊鉑埃安BU的研發、生產、銷售等環節效率不斷提升,產品迭代和新車投放節奏明顯加快。作為埃安全新Ray車系的首款新車,Ray7是埃安開啟年輕化序列的關鍵落子,也是廣汽切入20萬級市場的重要佈局。這一細分市場競爭並不輕鬆:小鵬P7、極氪007等車型已經提前卡位。Ray7想在年輕人心中佔位,不能只堆參數,更要把智能座艙與輔助駕駛、三電安全、補能效率、用車成本和價格權益上的差異,變成用戶可感、可信、可持續的體驗,這才是埃安年輕化的分水嶺。(雷峰網(公眾號:雷峰網)) 雷峰網原創文章,未經授權禁止轉載。詳情見轉載須知。
梁聖又掀桌了!DeepSeek新模型斬殺GPT-6,許願式編程時代降臨
作者 | 楊京麗 編輯 | 李水青 10月17日報道,剛剛,DeepSeek V4.1 Flash更新至V4.1-Flash-1017版本,官方網頁端、App與API已同步更新至新模型,模型權重也已在HuggingFace和ModelScope開放下載。DeepSeek還向公眾開放自研搜索引擎的Search(搜索)與Fetch(抓取)API,兩個接口均定價為5元/千次。 此次更新距離該模型發佈僅過去一個多月。9月10日,DeepSeek正式推出V4.1-Flash,在性能上超越了DeepSeek-V4-Pro。