Architect Launches Liquid Inference, a Real-Time Auction for LLM Inference

2026年10月8日 08:53
站內 AI 整理稿

Architect Financial Technologies has launched Liquid Inference, an LLM router that runs a live auction for every request.Liquid Inference is an LLM inference marketplace from Architect where providers bid to serve each prompt.The buyer pays the lowest offer that meets its rules.

For developers, it is quite simple message: swap a base URL, keep your code, and let providers compete on price.What is Liquid Inference?Liquid Inference is an exchange-style router for LLM inference.According to Architect, providers post offers to serve specific models.

Each request is auctioned across every provider quoting the named model.The lowest-priced offer that meets the buyer’s rules wins.The product comes from a trading firm, not an AI lab.Architect runs the AX perpetual futures exchange.

In May 2026 it acquired a US Designated Contract Market to list GPU compute futures, pending regulatory review.The team used its experience building financial exchanges to create two-sided price discovery for inference.How does the inference auction work?

The flow has 4 steps: Request: A client sends a standard OpenAI or Anthropic API call.Rules: The buyer’s constraints filter eligible offers.Auction: Providers quoting that model compete.The lowest qualifying offer wins.Receipt: The max price is locked before generation.

Billing covers metered usage only.Buyers can set per-job cost caps, time to first token limits and minimum throughput.They can also require approved regions, zero data retention and provider or model allow lists.An Auto mode can pick the model for a given unit of work.

Harrison’s LinkedIn post adds routing rule presets and full multi-modal support.Account holders can view live order books, per-provider and per-model quotes, and cleared transactions.That level of market data is unusual for an LLM API.What do buyers get?

Drop-in compatibility with agentic coding tools.The post lists Claude Code, Codex, OpenCode, Cursor, Pi and Cline.Free email signup.The first 500 users get $20 of free inference, per Harrison.A referral program: 20% of referred fees as free inference, plus 10% on second-level referrals.

What do inference providers get?Providers onboard through the Liquid Inference app.Harrison says new providers are verified “in minutes, not weeks.” All prompts use the OpenAI API standard.A REST and WebSocket API registers models and quotes.Providers can update quotes based on their own costs.

That lets them sell spare GPU capacity only when they want.Payouts run through Stripe, with itemized records of every job.How does Liquid Inference compare with OpenRouter and Hugging Face?

FeatureLiquid InferenceOpenRouterHugging Face Inference ProvidersRouting modelPer-request auction across quoting providers Price-weighted load balancing, inverse square of price Fastest provider by default; :cheapest suffix optional Model / provider count“Hundreds” of models; providers not disclosed500+ models, 80+ providers 18 listed partners API compatibilityOpenAI and Anthropic-compatibleOpenAI-compatibleOpenAI-compatible, chat only Price capMax price locked before first tokenmaxprice parameter Not disclosedData controlsZDR, regions, allow listszdr, datacollection, only/ignore Provider preference orderPlatform feeNot disclosed5.

5% card credit fee, $0.80 minimum No markup Free credits$20 for first 500 users Not disclosed$0.10/month free, $2.00 PRO Public market dataLive order books and cleared tradesNot disclosedNot disclosed window.addEventListener("message",function(e){if(e.data&&e.data.mtpLiH){var f=document.

getElementById("mtp-li-frame");if(f)f.style.height=e.data.mtpLiH+"px";}}); Key Takeaways Liquid Inference auctions every LLM request across competing providers.Max price is locked before the first token, with a per-job receipt.

Works with OpenAI and Anthropic clients, including Claude Code and Cursor.First 500 users get $20 free; referrals earn 20% of fees.Fees, provider list and latency data are not yet public.Check out the Technical details.All credit goes to the researcher of this project.

Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?now you can join us on telegram as well.The post Architect Launches Liquid Inference, a Real-Time Auction for LLM Inference appeared first on MarkTechPost.

Related

相關文章

MarkTechPost AI生成式AI

認識 Voxel51 3.0:為實體 AI 打造的統一多模態資料平臺

Voxel51 已發布 Voxel51 3.0,這是其資料平臺的一次重大更新。Voxel51 3.0 是一個端對端的多模態資料平臺,將搜尋、篩選、標註和評估整合於單一系統中。該平臺鎖定針對機器人、車輛和工廠感測器資料進行模型訓練的團隊。此次發布新增了 Voxel51 Agent、資料溯源層及免費的自助式存取。重點摘要:規模:Voxel51 Agent 內建超過 45 個 MCP 工具、80 多個運算子及 18 個開源技能。執行環境:可於 app.voxel51.com 使用託管網頁應用程式,或於雲端、混合、地端及隔離環境中自行部署。未揭露本機 GPU 需求。效能:未發布產品基準測試。Voxel51 引用其自身調查數據作為依據。最佳亮點:免費方案包含 Voxel51 Agent、每月 30,000 次推論請求及 30 個運算小時。

19 小時前
何夕2077生成式AI

下一概念建模把文本生成提速最高31倍

斯坦福等聯合提出全新文本生成範式 NCM,生成速度狂飆 31 倍AIbase基地發佈於AI新聞資訊 · 1 分鐘閱讀 · Oct 16, 202633人工智能領域的文本生成技術迎來顛覆性創新。斯坦福大學與 Together AI 的研究人員近日聯手推出了一種截然不同於傳統自迴歸和擴散模型的全新文本生成範式——Next-Concept Modeling(簡稱 NCM,即“下一概念建模”)。該方法巧妙借鑑了圖像生成領域中“下一尺度預測”的思路,有望為未來的文本生成技術開闢全新的發展路線。在技術實現路徑上,NCM 模擬了人類“先構思宏觀大綱、再動筆填充細節”的寫作邏輯。整個系統通過兩階段訓練來完成:首先訓練多尺度殘差 VQ-VAE,從而得到能夠逐層補充信息的多層離散文本編碼;隨後凍結該系統,訓練 Transformer 模塊去預測下一層的編碼。在生成文本時,模型會先並行生成概念層面的宏觀大綱,接著逐層並行填充具體細節,最終組合成完整的文本內容。在實際測試表現中,NCM 交出了令人矚目的成績單。實驗數據顯示,在保持相近甚至更優生成質量的前提下,NCM 相對傳統的擴散語言模型實現了10到31倍的生成速度飛躍,並且在訓練過程中所需消耗的 token 數量也大幅減少。此外,在數獨等複雜推理任務上,它的表現也明顯優於傳統的自迴歸和擴散基線模型,同時還支持通過多生成候選挑選機制來進一步優化最終輸出效果。儘管目前該研究所使用的模型參數規模依然相對有限,其在擴大模型規模後的表現、精確文本以及長篇內容的生成能力仍有待後續驗證,但這一創新思路無疑打破了長期以來的技術慣性,為人工智能高效生成文本提供了充滿想象力的全新解法。本文來自AIbase日報掃碼查看歡迎來到【AI日報】欄目!這裡是你每天探索人工智能世界的指南,每天我們為你呈現AI領域的熱點內容,聚焦開發者,助你洞悉技術趨勢、瞭解創新AI產品應用。

23 小時前
雷峰網生成式AI

12.88萬起、華為電驅+L4同源智駕,Ray7能成為埃安年輕化的答卷嗎?

12.88萬起、華為電驅+L4同源智駕,Ray7能成為埃安年輕化的答卷嗎? 本文作者: 倪萍 2026-10-17 22:42 導語:10月17日,埃安轎跑Ray7正式開啟預售,預售價12.88 萬起。新車車長4.9米,軸距2.9米,車頭部分搭配3.25米的超長雙環燈帶,是埃安10年煥新的家族 10月17日,埃安轎跑Ray7正式開啟預售,預售價12.88 萬起。新車車長4.9米,軸距2.9米,車頭部分搭配3.25米的超長雙環燈帶,是埃安10年煥新的家族式標識。 新車採用寧德時代電池以及廣汽自研的彈匣電池2.0技術,能夠在充分釋放續航能力的同時,監控電池健康狀態。提供45.58kWh和62.98kWh兩種規格,續航可達702公里,整車風阻係數 Cd 低至 0.22。Ray7搭載華為DriveONE多合一電驅,以及華為DriveONE芯片級驅制融合架構,百公里制動僅為32.8米。底盤方面,Ray7搭載高性能前後穩定杆和後五連桿懸架,過彎極限更高,濾振更乾淨。智能化上, Ray7搭載27顆車規級全視角傳感器,採用文遠知行L4級Robotaxi同源大模型。這幫助新車能夠複用 L4 積累的海量場景經驗,在城區掉頭、繞行等複雜場景中可順利通行。自2025年廣汽推進“番禺行動”以來,昊鉑埃安BU的研發、生產、銷售等環節效率不斷提升,產品迭代和新車投放節奏明顯加快。作為埃安全新Ray車系的首款新車,Ray7是埃安開啟年輕化序列的關鍵落子,也是廣汽切入20萬級市場的重要佈局。這一細分市場競爭並不輕鬆:小鵬P7、極氪007等車型已經提前卡位。Ray7想在年輕人心中佔位,不能只堆參數,更要把智能座艙與輔助駕駛、三電安全、補能效率、用車成本和價格權益上的差異,變成用戶可感、可信、可持續的體驗,這才是埃安年輕化的分水嶺。(雷峰網(公眾號:雷峰網)) 雷峰網原創文章,未經授權禁止轉載。詳情見轉載須知。

1 天前
智東西生成式AI

梁聖又掀桌了!DeepSeek新模型斬殺GPT-6,許願式編程時代降臨

作者 | 楊京麗 編輯 | 李水青 10月17日報道,剛剛,DeepSeek V4.1 Flash更新至V4.1-Flash-1017版本,官方網頁端、App與API已同步更新至新模型,模型權重也已在HuggingFace和ModelScope開放下載。DeepSeek還向公眾開放自研搜索引擎的Search(搜索)與Fetch(抓取)API,兩個接口均定價為5元/千次。 此次更新距離該模型發佈僅過去一個多月。9月10日,DeepSeek正式推出V4.1-Flash,在性能上超越了DeepSeek-V4-Pro。

1 天前