Sarvam AI 推出 Saaras V4:涵蓋印度 22 種語言與全球英語的語音轉文字模型

2026年9月26日 21:56
站內 AI 整理稿

Sarvam AI has released Saaras V4, the newest generation of its speech recognition model.It covers all 22 scheduled Indian languages plus English, now including global English accents.Sarvam reports state-of-the-art accuracy across all 22 languages.Is it deployable?

Yes, through Sarvam’s API today, using model="saaras:v4".Weights are not public, and Sarvam’s SageMaker self-hosting docs currently cover Saaras v3 only.What is Inside Saaras V4 Saaras V4 is an encoder-decoder system.

An audio encoder converts the waveform into embeddings that carry phonetic and acoustic detail.A temporal-downsampling adapter then shortens that sequence and projects it into the language model’s embedding space.This keeps long recordings inside the decoder’s context budget.

The decoder is Sarvam-3B, a 3B-parameter hybrid state-space language model trained from scratch in-house.It reads the audio features alongside a text prompt.It then emits the transcript autoregressively, feeding each token back as input for the next.

Benchmark Results English: Sarvam evaluated 7 English datasets.Six come from Hugging Face’s Open ASR Leaderboard: AMI, GigaSpeech, LibriSpeech clean, LibriSpeech other, SPGISpeech and VoxPopuli.The seventh is AI4Bharat’s Indian-accented Svarah.Scoring follows the leaderboard’s normalization code.

Saaras V4 posts the lowest average WER among the models Sarvam benchmarked.Indic: On Vistaar, Sarvam reports results across 10 Indian languages using both WER and LLM-WER.LLM-WER adds a semantic check.

It separates real meaning errors from harmless spelling or formatting variants common in Indic scripts.Noisy audio: On Kathbath Noisy, measured with LLM-WER, Sarvam says Saaras V4’s error rate is under half that of Deepgram Nova-3 and GPT-4o Transcribe.

The set includes compressed, clipped and background-heavy recordings.Language ID: On verified IndicVoices utterances, language identification error is 2.9% across the top 10 Indian languages.It is 5.22% across all 22.It is important to note that all numbers above are vendor-reported.

Independent reproduction has not been published yet.5 Output Modes From 1 Model The same audio can return 5 representations, selected through the mode parameter: transcribe (default): native script with numbers and dates normalized.verbatim: every word as spoken, fillers and spoken numbers kept.

codemix: native script, with English words left in English.translit: the full utterance in Latin script.translate: an English translation with numbers normalized.Sarvam’s argument is simple.Handling these inside the model removes post-processing steps that can compound errors.

Keyterm Prompting Keyterm prompting is new in V4 and works only with saaras:v4.You pass a JSON list under keyterms, with up to 50 terms of 64 characters each.Keyterms bias recognition; they do not guarantee output.Use codemix mode when a brand such as PhonePe must stay in Latin script.

On IndicContextEval (paper, Interspeech 2026), Saaras V4 reports 16.03% WER in the L5 keyword-prompting setting.Sarvam says that is the lowest score on the benchmark.Streaming, Long Audio and Pricing Streaming: WebSocket with partial results and time to first token below 150 ms.

REST: synchronous transcription for clips up to 30 seconds.Batch: asynchronous jobs up to 2 hours per file, with optional speaker diarization.SDKs: Python 3.9+ and Node.js 18+, plus LiveKit Agents, Pipecat and Vercel AI SDK integrations.

Price: Sarvam lists speech-to-text at ₹30 per hour for real-time, streaming and batch, and ₹45 per hour with diarization.Saaras v3 stays the default model.V4 uses the same request shape, so switching is a 1-line change.window.addEventListener("message",function(e){if(e.data&&e.data.

sv4Height){var f=document.getElementById("mtp-sv4-frame");if(f)f.style.height=e.data.sv4Height+"px";}}); Saaras V4 vs Closest Competitors These are the 3 systems Sarvam benchmarked against.Figures come from each vendor’s public docs and pricing pages, checked on September 26, 2026.

FeatureSarvam Saaras V4Deepgram Nova-3ElevenLabs Scribe v2OpenAI GPT-4o TranscribeIndian scheduled languages (of 22)221114Not listed per languageTotal languages23 (22 Indian + English)45+90+MultilingualKeyterm biasingUp to 50 termsYes, paid add-onUp to 1,000 (batch), 50 (realtime), paid add-onFree-text promptBuilt-in output modes5 (transcribe, verbatim, codemix, translit, translate)Transcript plus Smart FormattingVerbatim or no_verbatimTranscriptReal-time streamingWebSocket, under 150 ms TTFT (vendor claim)Yes (WebSocket)Scribe v2 Realtime, about 150 msFile streaming; live via Realtime APISpeaker diarizationBatch APIYesUp to 32 speakersSeparate gpt-4o-transcribe-diarize modelList price₹30/hour$0.

0052/min (multilingual, pre-recorded)$0.22/hour (batch)~$0.006/minSelf-hostingNot for V4 yet (v3 on SageMaker)YesCloud APICloud API Key Takeaways Saaras V4 covers all 22 Indian languages plus global English in 1 model.

A 3B hybrid state-space decoder, trained from scratch, sits behind an audio encoder.Keyterm prompting accepts up to 50 terms and scored 16.03% WER on IndicContextEval L5.5 output modes and sub-150 ms streaming TTFT come from the same model.

API-only today at ₹30 per hour; self-hosting docs still cover v3.Check out the Technical Details.All credit goes to the researcher of this project.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?

now you can join us on telegram as well.Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?

Connect with us The post Sarvam AI Releases Saaras V4: A Speech-to-Text Model for All 22 Indian Languages and Global English appeared first on MarkTechPost.

Related

相關文章

雷峰網模型更新

阿里巴巴:已正式申請平頭哥獨立上市

本文作者: 徐咪 2026-11-10 20:46 導語:11月10日晚,阿里巴巴集團發佈公告:已向香港聯交所交表,申請旗下子公司平頭哥獨立上市。上市完成後,平頭哥仍將是阿里巴巴子公司。公告顯示,2026年9月11日, 11月10日晚,阿里巴巴集團發佈公告:已向香港聯交所交表,申請旗下子公司平頭哥獨立上市。

12 小時前

字節跳動 Seedream 5.5 正式登陸豆包:圖片設計能力迎全方位升級

此次接入將為廣大用戶帶來更加專業、高效的視覺生成與編輯體驗。三大核心功能全面落地,徹底打破傳統 AI 繪圖痛點通過引入 Seedream5.5模型,豆包在圖像創作和後期處理上實現了多維度的技術突破:百輪穩定連續編輯: 傳統模型在對生成圖片進行局部修改時,往往會出現整體風格漂移或畫質受損。

15 小時前6200

蘋果 Siri AI 隱藏調度規則曝光:Skimmer 前置攔截,2% 英文高頻請求悄悄走本地

根據最新曝光的消息顯示,在蘋果推送的 iOS / macOS27.3首個開發者預覽版 Beta 中,系統為 Siri AI 引入了一項名為 Skimmer 的全新前置模塊,首次實現了將大約2% 的英語請求直接路由到本地進行處理。核心調度規則:覆蓋高頻固定指令,實現降本增效與隱私保護根據爆料信息,在聯網狀態下,這部分被分流到本地端側模型處理的請求,主要涵蓋了設置定時器、播放音樂以及撥打電話等日常生活中最為高頻且結構相對固定的指令。

17 小時前5900
智東西模型更新

螞蟻靈波又放大招!機器人通用大腦學會共享“手感”

作者 | 周加琦 編輯 | 漠影 具身智能正在加速突破靈巧操作的能力邊界,但不同靈巧手之間,仍然存在一道難以跨越的觸覺數據鴻溝。 如何打破不同傳感器之間的數據壁壘,成為實現通用靈巧操作的重要一步。 11月10日報道,螞蟻靈波正式開源面向靈巧操作的觸覺預訓練基礎模型LingBot-Touch。該模型能統一處理壓阻式、視觸覺等不同類型的傳感信號,將其編碼為統一、可複用的觸覺表徵,供不同靈巧手和策略模型使用。 在真機測試中,LingBot-Touch與兩款不同靈巧手和四種策略模型結合,完成26項真實操作任務。

17 小時前
雷峰網模型更新

四維圖新創想大會 | 以數據與算力為基,SEEWAY.AI駛向新一站

11月6日,四維圖新在上海舉辦2026 EVOLUTION創想大會。CEO 程鵬全面解讀穿越 “極點” 的破局方向,以數據與算力為基,答行業焦點之問,並正式公佈向移動智能體領域拓展的戰略佈局。數據之戰,先拿好合規這張入場券"過去十年,中國新能源贏在電池;未來十年,中國汽車要贏在數據。"程鵬的判斷直指行業下一個核心戰場——數據已成為汽車智能化的"第二戰場",而用好數據的前提,是合規。監管的門檻正在快速抬高。

17 小時前

騰訊首款專屬 AI 遊戲陪伴"鵝次元"內測:讓 AI 鑽進遊戲畫面陪你開黑

騰訊把解法塞進了屏幕裡。11 月 10 日,騰訊首款專屬 AI 遊戲陪伴 Agent"鵝次元"低調開啟內測。作為坐擁海量遊戲版權的廠商,騰訊把 AI 從客服和工具,順勢推到了玩家的屏幕旁——這款產品瞄準 PC 玩家,提供擬人化陪伴與實時語音互動,試圖在競技之外補上"有人陪"的體驗缺口。

21 小時前6900