You.com Launches Inference Router: 12 Open-Weight Models With 99.9% Uptime SLA

2026年10月23日 05:28
站內 AI 整理稿

You.com has launched Inference Router, a managed API for running open-weight models in production.The You.com Inference Router is an OpenAI-compatible service that routes requests across 12 live models.It bundles a 99.9% minimum uptime SLA and zero data retention (ZDR).

It adds 100% US hosting and server-side web search.It is pay-as-you-go, with no platform fee.TL;DR Size: 12 live models, from GPT-OSS 120B (125K context) to Kimi K3 and Qwen3.8 Max (1M context).Kimi K3 is a 2.8T-parameter model; Qwen3.8 Max is a 2.4T MoE.Runs on: Fully managed.Requests hit You.

com Inference Direct first, then fail over to US-hosted partners.No GPUs to manage.Performance: On You.com’s LiveNewsBench run, open-weight models plus You.com search matched frontier models at lower cost.Best: GLM-5.3 with You.com search scored 86.53%, at $0.0485 per question versus $0.

0920 for Claude Sonnet 5.5 (self-reported).Worst: Per-token prices sit near market.Kimi K3 is $2.85/$14.25, only 5% below Together AI’s $3.00/$15.00.What is You.com Inference Router?It is one API for many open-weight models.The endpoint is https://api.you.

com, with OpenAI-compatible and Anthropic-compatible routes.Existing SDK code moves over by changing the base URL and key.You.com team frames the problem around stalled migrations.Dev teams test open-weight models on aggregators, then hit security review.

Reviewers ask about ZDR, US hosting, access controls and DPAs.Dedicated providers clear those bars, but usually with a large commitment.Inference Router targets that gap.How does the routing and failover work?Every request goes first to You.com Inference Direct, the company’s own inference capacity.

If it is down or full, the request fails over to a vetted partner.The official post names Parasail, Wafer, Alibaba Cloud, Meta and Inception, with Prime Intellect coming soon.All are 100% US-hosted and must meet ZDR rules.Failover does not change the bill.Each model has 1 published per-token price.

You.com also offers spend caps per API key and daily usage views by model, cost and provider.Accounts run on SOC 2 compliant infrastructure, with a DPA on request.What does zero data retention cover?The ZDR policy states that prompts and outputs are processed in memory and not stored.

It covers both model calls and web search requests.You.com keeps only operational metadata, such as token counts, timestamps and account IDs.Prompt hashes, de-identified text and disk-backed prompt caches are explicitly excluded.Which models are available, and what do they cost?

The models page lists 12 live models, all US-hosted.Prices are per 1M tokens (input / output): Kimi K3 (Moonshot AI): $2.85 / $14.25, 1M context Qwen3.8 Max (Alibaba): $1.85 / $5.55, 1M context GLM 5.3 (Z.ai): $1.35 / $4.25, 1M context DeepSeek V4 Pro: $1.65 / $3.65, 1M context DeepSeek V4.

1 Flash: $0.30 / $1.20, 1M context Mercury 3 (Inception): $0.10 / $0.35, 1M context GPT-OSS 120B (OpenAI): $0.097 / $0.73, 125K context Muse Wonder, Muse Spark 1.3, GLM 5.3 Flash, Qwen3.8 Flash and MiniMax M3 round out the list.How does built-in web search work?

Developers declare a websearch or webextract tool, and the router runs searches for the model.The docs show up to 20 results per search and a default of 30 search rounds.Responses return a webresults object with citations.Search runs on the same server as the model.You.

com says internal tests show up to 15% lower latency.Send request + With websearch Simulate outage idle ≥99.9%Uptime SLA with service credits

0%Platform fee (OpenRouter: 5.5%)

Up to 15%Lower latency, server-side search (internal test) Failover partners named in the launch post: Parasail, Wafer, Alibaba Cloud, Meta, Inception; Prime Intellect coming soon.Failover never changes the price.<!-- 1: models --> Input $/1MOutput $/1M Prices per 1M tokens from you.

com/product/inference-router/models, checked Oct 22, 2026.All models US-hosted with ZDR.<!-- 2: benchmarks --> AccuracyCost per question LiveNewsBench, 1,329 questions, list prices.Accuracy bars start at 80%.You.com's own Oct 2026 run using Braintrust's open-source search eval (self-reported).

Purple = open-weight + You.com search; grey = closed model with built-in search.<!-- 3: compare --> You.comOpenRouterTogether AIFireworks AI Uptime SLA≥99.

9%, pay-as-you-goNot disclosedBest-effort; 99% with PTU commitNot disclosed ZDRDefault, models + searchNo prompt logging defaultOff by defaultOn by default (open models) Platform fee0%5.5%None listedNone listed Kimi K3 in/out$2.85 / $14.25Varies by provider$3.00 / $15.00$3.00 / $15.00 (US-only $4.

50 / $22.50) US hosting100% incl.failoverVariesNot disclosedUS tier at premium

Sources: openrouter.ai/docs/faq, together.ai/pricing, docs.together.ai, docs.fireworks.ai/serverless/pricing. Checked Oct 22, 2026. <!-- 4: quickstart --> 1 · Install2 · Change base URL3 · Add search </d

Related

相關文章

砸下 150 億美元!DeepSeek 攜手寧德時代轉戰內蒙古,1GW 國產智算中心掀起基建狂潮

DeepSeek 攜手寧德時代轉戰內蒙古,1GW 國產智算中心掀起基建狂潮發布於AI新閒資訊時間 :Oct 23, 2026閱讀 :1分鐘據 多家權威媒體報道,人工智能領域迎來了一筆備受矚目的鉅額投資。DeepSeek 近期正接近完成規模高達150億美元的新一輪融資,這筆資金的核心用途已明確鎖定——用於在內蒙古烏蘭察布市投資建設一塊規模達到1GW 的全新數據中心。

36 分鐘前3400

Hugging Face 推出 Carbon-X:基於千問,讓科學家"與 DNA 對話"

這是一個 140 億參數、用於 DNA 理解與生成的開放模型。它的玩法很新鮮——把 DNA 序列和自然語言揉進同一個模型。研究者能拿特定序列提問、預測突變影響,甚至生成新的 DNA 片段;它還能當"專業副手",幫別的模型讀懂原本看不透的基因。

1 小時前5100

火山引擎發佈Seedance2.54K:480P樣片打磨後生成4K正片

該版本通過專項訓練,更充分地學習人物表情、細微動作與畫面細節,是Seedance2.5這一代中最強的模型。產品支持Draft(樣片)模式,終端用戶可先用480P樣片快速驗證分鏡、反覆打磨鏡頭,確定滿意效果後再生成4K正片,以更優成本給足創意探索空間。

1 小時前4500

Etsy宣佈禁止平臺銷售AI生成食譜與手工圖樣

此舉旨在應對平臺日益嚴峻的信任危機,遏制AI生成內容對買賣雙方交易體驗的負面衝擊。當前,由於買家難以分辨商品中是否包含AI生成內容,該問題已演變為阻礙用戶活躍交易的核心障礙之一,同時誠實賣家也面臨著原創作品被誤導性AI商品稀釋的困境。為此,Etsy進一步收緊了規範,明確規定賣家必須展示根據說明製作出的未經修改的實物照片,並禁止通過機器人程序完全無人參與地自動生成商品刊登信息。

2 小時前4400