vLLM Semantic Router Releases d3-ultra: A 27B Open Multimodal Decision Model
The vLLM Semantic Router team has released d3-ultra, a 27B multimodal decision model under Apache-2.0.The d3-ultra decision model does not generate text.It reads an input once and returns a probability for every answer to every question.
For developers, that means routing, classification, visual grounding and video checks from 1 open-weight call.TL;DR Size: 26.09B parameters (dense, including a 0.46B vision encoder); 131,072 tokens of context per question.
Runs on: tested on 1 AMD Instinct MI325X with BF16 weights; no official quantized variant is listed yet.Performance: highest SR-Text score of the 6 decision models in the team’s own private test.Best: 97.8 on SR-Text tools and automation (chance-corrected accuracy).Worst: 54.
6% on SR-Box (9 domains), 5.0 points below its sibling d3-turbo.What is d3-ultra?d3-ultra is a System One decision model from vLLM Semantic Router that answers typed questions with probabilities.It is the newest member of Decision 3.0, a family that spans 0.6B to 27B.
You send a state (text or JSON, plus images or videos) and a set of questions.Each question has a type: Choice: pick 1 of several options.Yes / No: return the probability of yes.Score: rate on a scale.Box: locate something in an image or a video moment.Track: follow a target across a whole video.
Images can also sit inside questions and options.A quiz can show a photo, then offer 4 etchings as answers.How does d3-ultra work?The core idea is state once.The model reads the input once per request and answers every question from that single read.The config shows a Qwen3.
5-architecture backbone with 64 layers.48 are linear-attention layers and 16 are full-attention layers.The card does not name its base checkpoint.vLLM’s recipe says the sibling d3 was trained from Qwen3.8-27B.Box answers always return exactly 1 box with a confidence.
A confidence near 0 means the target is not in the picture.Questions over 131,072 tokens fail with maxlengthexceeded; nothing is silently truncated.How does d3-ultra perform on benchmarks?The research team compares d3-ultra with GLiDE V1.2, d1-ultra, d3-turbo, d3 and Jev 1.14 on 2 in-house tests.
SR-Text has 10,411 text requests with 73,495 questions.Most recreate skills from 34 public benchmarks with new items.Another 4,896 questions come from 43 new task families, like SQL checks and ticket routing.Scores are chance-corrected: 0 is chance, 100 is perfect.d3-ultra: 87.2 GLiDE V1.2: 85.
1 d1-ultra: 83.4 d3-turbo: 83.1 d3: 81.4 Jev 1.14: 73.1 d3-ultra leads every area except arts and human taste.There, d1-ultra scores 90.8 against 89.6, within the margin of error.SR-Box has 5,678 Box questions on 4,984 images across 10 domains.A box counts as correct at IoU 0.5 or higher.
d3-ultra scores 58.2% over 10 domains and 54.6% over 9.d3-turbo scores 60.0% and 59.6%.Jev 1.14 scores 45.7% and 46.9%.The team says d3-turbo stays stronger on natural images, while d3-ultra leads on charts.Latency: on 1 AMD Instinct MI325X with AutoModel, 1 question about a photo takes 304 ms.
255 questions take 2.16 s, about 7.3 ms per extra question.(function(){var f=document.getElementById('mtp-d3u-frame'); window.addEventListener('message',function(e){if(e.data&&e.data.mtpD3u&&e.source===f.contentWindow){f.style.height=e.data.height+'px';}});})(); How do you deploy d3-ultra?
There are 4 routes: Transformers: AutoModel.frompretrained("vllm-sr/d3-ultra", trustremotecode=True) with transformers==5.17.0.The optional flash-linear-attention package adds fast GPU kernels.vLLM Semantic Router Engine: vllm-sr serve -e vllm-sr/d3-ultra, added in PR #5449 on October 25, 2026.
Free API: the card says decision.vllm-sr.ai serves d3-ultra, with a free key.Demo: the official Hugging Face Space.d3-ultra vs GLiDE V1.2, d1-ultra, Jev 1.14 and d3-turbo Featured3-ultrad3-turboGLiDE V1.2d1-ultraJev 1.
14DevelopervLLM Semantic RoutervLLM Semantic RouterFastino LabsLiquid AITypeSafeParameters26.09B26.09B26B Not disclosedNot disclosedContext per question131,07232,768 default; 131,072 with longcontext40,000 default32,768 262,144 Weights / licenseOpen, Apache-2.0Open, Apache-2.
0Open, Fastino Community LicenseHosted onlyHosted only, proprietaryInputsText, JSON, images, videoText, JSON, images, videoText, JSON, imagesText, imagesText, imagesBox / trackBox + trackBox + trackNoNoBox onlySR-Text (self-reported by vLLM-SR)87.283.185.183.473.1SR-Box, 10 domains58.2%60.
0%Not supportedNot supported45.7%Public index scoreSubmitted, not yet on board70.2 Jev DI (own estimate)71.5 Decision Index 0.4.165 AA Decision Index 57 AA Decision Index PriceFree API, self-hostFree API, self-host$0.04 / M input $0.042 / M input$0.
042 / M input Key Takeaways d3-ultra is a 27B Apache-2.0 decision model that never generates text.It reads input once: 255 questions about 1 photo take 2.16 s.It tops the team’s SR-Text test at 87.2, ahead of GLiDE V1.2 at 85.1.It trails d3-turbo on Box grounding: 58.2% vs 60.0%.
All benchmark numbers are self-reported on private test sets.Check out the model card, the GitHub repo, the Decision 3.0 collection and the Hugging Face Space.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!
are you on telegram?now you can join us on telegram as well.Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?
Connect with us The post vLLM Semantic Router Releases d3-ultra: A 27B Open Multimodal Decision Model appeared first on MarkTechPost.
Related
相關文章
曝OpenAI拿下超6.7億年單!打“骨折”、送額度、配工程師,就為了搶Anthropic客戶
編譯 | 孫小雯 編輯 | 程茜 OpenAI和Anthropic為了搶用戶,最近又槓上了!10月30日,OpenAI剛將部分Pro套餐的ChatGPT Work和Codex額度翻倍;次日,Anthropic取消了已驗證Ultra賬戶的5小時用量限制,周限額保留。
英特爾與騰訊發佈基於至強6+的雲實例,曬智能體AI基礎設施全家桶
作者 | ZeR0 編輯 | 漠影 11月3日報道,近日,在2026騰訊全球數字生態大會上,英特爾與騰訊雲發佈基於英特爾至強6+處理器的騰訊雲新一代雲實例,並全面展示英特爾的芯片產品與雲端實踐。 全新至強6+處理器擁有最高288顆能效核,單顆處理器最高可支持超過1000個智能體的穩定部署,這也為騰訊雲服務器提供更高併發、更低時延、更優能效的雲端算力服務。
智元榮獲2026世界互聯網大會傑出貢獻獎
11月3日,2026年世界互聯網大會烏鎮峰會在浙江烏鎮隆重開幕,國務院總理李強出席開幕式並發表主旨演講。開幕式上,智元憑藉在具身智能領域的系統性技術突破與產業化實踐,獲頒世界互聯網大會傑出貢獻獎。智元合夥人、高級副總裁朱潔在領獎時表示:人工智能的終局,不在於屏幕與雲端,而紮根於工廠一線和尋常煙火。具身智能賽道的競爭,早已跳出單點技術的競速,轉向軟硬協同、工程化落地、產業組織與治理體系的綜合比拼。智元期待與各界同心同行,堅守務實,躬身落地。
電動車退燒、AI 儲能燒起來:LG 新能源把產能挪向數據中心
11 月 3 日,首席財務官李昌植在財報電話會上給出時間表:今年底軟包儲能系統(ESS)產能將超 50 吉瓦時,明年進一步拉到 70 GWh 以上。在他看來,電動車增速放緩之際,AI 數據中心的大規模新建為電池廠撕開了新口子——第三季度 ESS 在手訂單已達 160 GWh,公司正與電力企業、超大型數據中心運營商談新項目,今年 9 月還作為儲能供應商擠進了英偉達的 DSX Ready 計劃。
最高288核的至強6+,為了Agent高密度部署還下了哪些「雲功夫」?
作者 | 陳悅琳編輯 | 包永剛 一個智能體能順利完成任務,不代表成百上千個智能體就能同時高效運行。 對於承載大量智能體任務的雲服務器而言,除了提升計算速度,如何在任務集中到來時迅速準備好執行環境、怎樣減少暫時閒置的任務對內存資源的佔用,也成為亟待解決的問題。 對此,在一年一度的騰訊全球數字生態大會上,英特爾與騰訊雲聯合發佈了基於至強6+處理器的新一代雲實例,圍繞任務啟動效率、內存資源利用率等關鍵因素進行優化後,其綜合性能較上一代提升30%以上。
聯合國副秘書長點贊!千問AI耳夾式耳機亮相烏鎮互聯網大會
他認為,產品非常實用,適合自己日常工作中需要使用多國語言進行交流的場景。面對面交流時,用戶可以通過耳機收聽譯文;會議中的討論內容,也能通過AI聽記整理為結構化紀要,方便會後回顧。連接千問App後,用戶還可通過語音交辦資料研究等任務、接收完成提醒,讓耳機成為日常辦公的隨身助手。