Hugging Face Blog研究與前沿

Baseten 加入 Hugging Face 推理提供者陣容 🔥

2026年8月6日 00:00

重點摘要

我們很高興宣佈,Baseten 現已成為 Hugging Face Hub 支援的推理提供者之一!Baseten 的加入擴展了 Hub 模型頁面上的無伺服器推理服務,並與我們的 JS 和 Python 客戶端 SDK 無縫整合,讓使用者能更輕鬆地透過偏好的提供者使用多種模型。

站內 AI 整理稿

Back to Articles Baseten on Hugging Face Inference Providers 🔥 Published August 6, 2026 Update on GitHub Upvote 1 Alex Ker alexker-baseten Follow baseten Roland Crosby rolandcrosby-baseten Follow baseten Sid Shanker squidarth Follow baseten Johan johan-baseten Follow baseten Célina Hanouti celinah Follow Simon Brandeis sbrandeis Follow Lucain Pouget Wauplin Follow merve merve Follow We're thrilled to share that Baseten is now a supported Inference Provider on the Hugging Face Hub!

Baseten joins our growing ecosystem, enhancing the breadth and capabilities of serverless inference directly on the Hub's model pages.

Inference Providers are also seamlessly integrated into our client SDKs (for both JS and Python), making it super easy to use a wide variety of models with your preferred providers.Baseten is an AI infrastructure platform that covers serverless AI, training and more.

With a catalog of many frontier models, Baseten makes it easy for developers to integrate a wide range of AI capabilities into their applications with minimal setup.Baseten supports a broad spectrum of model types - from LLMs to text-to-speech and more.

As part of this initial integration, Baseten is launching support for conversational and text-generation tasks on Hugging Face, enabling access to popular open-weight LLMs such as Kimi K3, latest DeepSeek V4 Flash, GLM-5.2, and many more.Support for additional tasks will roll out soon!

See the full list of models supported by Baseten here.Follow Baseten on Hugging Face: https://huggingface.co/baseten.How it works In the website UI In your user account settings, you are able to: Set your own API keys for the providers you've signed up with.

If no custom key is set, your requests will be routed through HF.Order providers by preference.This applies to the widget and code snippets in the model pages.

As mentioned, there are two modes when calling Inference Providers: Custom key (calls go directly to the inference provider, using your own API key of the corresponding inference provider) Routed by HF (in that case, you don't need a token from the provider, and the charges are applied directly to your HF account rather than the provider's account) Model pages showcase third-party inference providers (the ones that are compatible with the current model, sorted by user preference) From the client SDKs Baseten is available through the Hugging Face SDKs - huggingface_hub (>= 1.

26.1) for Python and @huggingface/inference for JavaScript.The following examples show how to use the latest DeepSeek V4 Flash through Baseten.Use a Hugging Face token to authenticate - the request will be routed to Baseten automatically.

From your favorite Agent Harness Hugging Face Inference Providers are integrated in most Agent Harnesses - including Pi, OpenCode, Hermes Agents, OpenClaw, and more.This means you can plug baseten-hosted models straight into your favorite tools without any extra glue code.

Browse the full list of integrations here.from Python import os from openai import OpenAI client = OpenAI( base_url="https://router.huggingface.co/v1", api_key=os.environ["HF_TOKEN"], ) completion = client.chat.completions.

create( model="deepseek-ai/DeepSeek-V4-Flash-0731:baseten", messages=[ { "role": "user", "content": "Write a Python function that returns the nth Fibonacci number using memoization." } ], ) print(completion.choices[0].

message) from JS import { OpenAI } from "openai"; const client = new OpenAI({ baseURL: "https://router.huggingface.co/v1", apiKey: process.env.HF_TOKEN, }); const chatCompletion = await client.chat.completions.

create({ model: "deepseek-ai/DeepSeek-V4-Flash-0731:baseten", messages: [ { role: "user", content: "Write a Python function that returns the nth Fibonacci number using memoization.", }, ], }); console.log(chatCompletion.choices[0].message); Billing For direct requests, i.e.

when you use the key from an inference provider, you are billed by the corresponding provider.For instance, if you use a baseten API key you're billed on your baseten account.For routed requests, i.e.when you authenticate via the Hugging Face Hub, you'll only pay the standard provider API rates.

There's no additional markup from us; we just pass through the provider costs directly.(In the future, we may establish revenue-sharing agreements with our provider partners.) Important Note ‼️ PRO users get $2 worth of Inference credits every month.You can use them across providers.

🔥 Subscribe to the Hugging Face PRO plan to get access to Inference credits, ZeroGPU, Spaces Dev Mode, 20x higher limits, and more.We also provide free inference with a small quota for our signed-in free users, but please upgrade to PRO if you can!

Feedback and next steps We would love to get your feedback!Share your thoughts and/or comments here: https://huggingface.

co/spaces/huggingface/HuggingDiscussions/discussions/49 Models mentioned in this article 3 Spaces mentioned in this article 1 More Articles from our Blog llmsinference-providersdeepinfra DeepInfra on Hugging Face Inference Providers 🔥 +4 14 April 29, 2026 llmsinference-providersscaleway Scaleway on Hugging Face Inference Providers 🔥 +5 24 September 19, 2025 Community EditPreview Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images Comment · Sign up or log in to comment Upvote 1 Models mentioned in this article 3 Spaces mentioned in this article 1

Related

相關文章

天才,對AI發展到底有多重要?

加拿大三位科學家傑弗裡·辛頓、約書亞·本希奧和理查德·薩頓對當代人工智慧發展有重大貢獻,凸顯少數天才就能左右一個國家的技術地位。文章從1956年達特茅斯會議談起,探討人工智慧領域的關鍵爭論與發展脈絡。

剛剛

Jeff Dean們,趕在貝葉斯AI到來之前跳船

Jeff Dean 離開任職27年的Google,創辦Discovery Loop公司,目標是讓AI進入持續運行的科學發現循環。Google DeepMind論文《LLM can't jump》指出,科學發現需要從經驗事實跳躍到新原則,而當前大型語言模型缺乏這種跳躍能力。研究顯示貝葉斯AI時代即將到來,大廠正積極補足Agent的基礎建設。

5 小時前

Meta重新支稜起來了?純推理拿下五項奧賽金牌,兩項滿分

Meta近期在人工智慧領域展現出驚人實力,其開發的純推理模型在國際數學奧林匹亞競賽中一舉奪下五面金牌,其中兩項更獲得滿分成績。這項成果不僅凸顯了Meta在AI推理能力上的突破,也讓外界重新審視這家科技巨頭在深度學習與邏輯運算方面的技術積累。 根據相關資訊,這款模型並未依賴外部知識庫或預先訓練的數據,而是透過純粹的推理機制來解決複雜數學問題。在競賽中,它成功應對多道高難度題目,涵蓋代數、幾何與數論等領域,最終以五項金牌的成績證明其演算法的有效性。其中兩項滿分表現,更顯示模型在特定題型上的精準度已達到頂尖水準。

7 小時前

智元下架了首席科學家羅劍嵐

智元機器人官網合夥人團隊名單中已移除首席科學家羅劍嵐,其個人社群簡介也不再提及智元職務,疑似離職,但官方尚未證實。羅劍嵐於2025年4月加入智元,任職約1年4個月,期間主導真機強化學習與具身智能研究,此次人事變動發生在公司啟動赴港上市流程之後。

11 小時前