Google AI Releases Gemini 3.5 Transcribe: A Speech-to-Text Model Reporting 2.6% Average WER Across 85+ Languages
Google has released Gemini 3.5 Transcribe, a speech-to-text model for real-time voice interfaces and recorded audio.It ships as two endpoints, not one.gemini-3.5-transcribe handles pre-recorded files through the Interactions API.gemini-3.
5-transcribe-live handles bidirectional streaming through the Live API.Google reports average word error rates of 4.0% streaming and 2.6% non-streaming, as measured by Artificial Analysis.Time to final transcription improves 70% over Chirp 3, the previous model.
Automatic detection covers more than 85 languages, including mid-sentence code-switching.The split between the two endpoints is the part worth planning around.They do not share the same feature set, limits, or price.Is it deployable?Yes, but API-only.
There are no open weights and no self-hosted path.This is a managed-service decision, not an infrastructure one.Company level: Any.Solo developers and startups can start on the Gemini API free tier via Google AI Studio.Mid-market teams move to the paid tier for higher rate limits.
The paid tier also guarantees content is not used to improve Google’s products.Regulated enterprises route through the Gemini Enterprise Agent Platform, which adds provisioned throughput, compliance controls, and volume discounts.
Both developer and enterprise tracks are in public preview, so treat production commitments accordingly.Industries: Contact centers and CX platforms, clinical documentation, media captioning and localization, legal and insurance intake, meeting tooling, and voice-driven developer tools.
Applications: Real-time voice agents, live captioning, post-call analytics pipelines, meeting transcription with speaker attribution, dictation, and voice-controlled interfaces.(function(){ window.addEventListener('message', function(e){ if(e && e.data && e.data.mtpG35T && e.data.
h){ var f = document.getElementById('mtp-g35t-frame'); if(f) f.style.height = e.data.h + 'px'; } }); })(); Two API surfaces, two different products The Live API delivers sub-second, continuous transcription.
It emits interiminputtranscription for speculative partials while someone is still talking, then input_transcription when the turn finalizes.Audio goes in as raw 16-bit PCM at 16kHz mono, in 100ms chunks.It supports automatic, hybrid, and manual voice-activity detection.
Ephemeral tokens let mobile and web clients stream without holding an API key.The constraints are real.Live sessions cap at 10 minutes of continuous streaming.Speaker diarization is not supported.Word-level timestamps are not supported.The Interactions API covers what streaming cannot.
It offers speaker diarization, word-level start and end offsets, and custom vocabulary biasing.The vocabulary list takes up to 1,000 terms, with best results below 100.Standard requests accept up to one hour of audio.That drops to 30 minutes once diarization or word timestamps are enabled.
Verbatim and smart are the real design decision Both endpoints expose two modes.verbatim is the default and returns everything, including fillers, repetitions, and false starts.smart removes disfluencies, resolves spoken self-corrections inline, and applies structured formatting.
Google’s own documented example: “Um, so for the meeting, I think we should, uh, invite Alice and, wait no, Bob and Carol.” Verbatim keeps all of it.Smart returns “For the meeting, I think we should invite Bob and Carol.” Smart mode cannot be combined with word timestamps or diarization.
That is the tradeoff to plan around.A readable summary and an auditable transcript are now two different API calls.Performance As measured by Artificial Analysis, Google reports an average word error rate of 4.0% for streaming and 2.6% for non-streaming.
On the multilingual FLEURS benchmark, across a set of top languages and locales, the model reports 5.50% streaming and 5.04% non-streaming.Against Chirp 3, Google’s previous transcription model, time to final transcription improves by 70%.
Language coverage spans over 85 locales with automatic detection and code-switching handled without configuration.Ecosystem The Live API is already wired into LiveKit, Pipecat, Agora, Fishjam, Vercel, and Vision Agents.
On the consumer side, the model powers Rambler on Android, the Gemini app on macOS, and Google Antigravity.Chrome is listed as coming soon.Key Takeaways Two endpoints, not one: streaming trades diarization and word timestamps for sub-second latency.Reported WER is 4.0% streaming and 2.
6% non-streaming, per Artificial Analysis.Smart mode cannot be combined with timestamps or diarization — pick one per call.Blended cost runs about $0.005/min batch and $0.009/min live; no open weights.Hard limits: 10-minute live sessions, 1-hour files, 30 minutes with diarization on.
Check out the Technical details here.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?now you can join us on telegram as well.
Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?Connect with us The post Google AI Releases Gemini 3.5 Transcribe: A Speech-to-Text Model Reporting 2.6% Average WER Across 85+ Languages appeared first on MarkTechPost.
Related
相關文章
AI 浪潮下的社區無奈謝幕:知名反編譯追蹤網站decomp.dev宣佈關閉
該網站曾致力於集中展示匹配反編譯的進展,並凝聚志同道合的技術愛好者。然而,隨著近年來人工智能技術的迅猛發展,開源協作生態遭到嚴重破壞,創始人最終決定讓其退居為歷史數據存檔。匹配反編譯長期以來是一項極度耗時且艱難的任務。自2026年初 Opus4.
AI 系統 RFdiffusion3 能從原子層面造蛋白:實驗裡真能幹活
更硬核的是,用它全新設計的蛋白質,已在真實化學反應中兌現了預期功能。由美國華盛頓大學、英國牛津大學、英偉達等機構組成的國際團隊搭建了這套系統,可對單個原子建模,專門用於設計蛋白質與核酸,相關成果於當地時間 16 日刊登在國際期刊《科學》上。
迪士尼將以2000萬美元收購Character.AI部分資產並接納核心團隊
據彭博社披露的法律文件顯示,迪士尼已同意以2000萬美元收購 Character.AI 的部分資產,並向至少60名員工(佔其員工總數的大多數)提供總額約6000萬美元年薪的就業機會,目前絕大多數受邀員工已接受試探性報價。此次收購與人才吸納,凸顯了傳統娛樂巨頭在人工智能浪潮下對垂直領域技術團隊的深度整合。
不操控鍵鼠、自己寫代碼:4 個 Gemini 智能體在《我的世界》裡自主組隊擊敗末影龍
4個 Gemini4Argon 通用編碼智能體,在沒有人類替它們分派任何角色的情況下,僅憑遊戲內的聊天頻道和一份共享筆記,就自己商量著完成了分工,然後一頭扎進一個隨機生成的《我的世界》生存世界裡。這場硬仗打了27小時14分鐘,它們最終通關,把末影龍撂倒。
垂直大模型"同源觀瀾"在福州發佈:用 AI 把兩岸共同歷史記憶"激活"
10月18日,中華文化傳承與兩岸融合發展垂直大模型"同源觀瀾"在福建師範大學旗山校區正式發佈,它的使命很明確——用數字技術把兩岸共享的歷史記憶重新盤活。福建師範大學校長鄭家建點出了這套系統要解決的真實痛點:涉臺檔案資料浩如煙海,整理和考辨的難度極高。
Vercel數據表明決策模型Jev成史上採用最快AI模型
Jev於9月15日限量發佈,通過限制預設輸出數量實現更高速度與更低成本,成為快速分類大量數據的理想選擇,並已促使OpenAI和亞馬遜等公司推出競品。作為早期採用者,Vercel已利用Jev取代GPT-6Luna來識別有害指令。相關數據源自類似OpenRouter的統一 API 服務VercelAI網關,該報告同時指出開源模型已佔據處理代幣的70% 以上及總支出的近25%,而前沿實驗室支出亦實現十倍增長。