Best Open Speech Recognition (ASR) Models in 2026: WER, Languages, Latency, and License Compared
重點摘要
Open speech recognition stopped being a Whisper monoculture some time in the last twelve months. In March 2026 Cohere released Transcribe, a 2B Apache 2.0 model that took the top of the Hugging Face Open ASR Leaderboard at 5.42% average word error rate. Five weeks later IBM shipped Granite Speech 4.1 2B at 5.33%. Since then ARK-ASR-3B and MOSS-Transcribe-preview-2B have posted lower numbers still. The top of that leaderboard is now separated by less than one WER point. That has a specific consequence for anyone choosing a model: rank is no longer the deciding variable. License, language coverage, streaming support, and cost per audio-hour are. This roundup compares the field on all four. (function(){ window.addEventListener("message", function(e){ if(!e.data || typeof e.data.mtpAsrHeight !
Open speech recognition stopped being a Whisper monoculture some time in the last twelve months.In March 2026 Cohere released Transcribe, a 2B Apache 2.0 model that took the top of the Hugging Face Open ASR Leaderboard at 5.42% average word error rate.Five weeks later IBM shipped Granite Speech 4.
1 2B at 5.33%.Since then ARK-ASR-3B and MOSS-Transcribe-preview-2B have posted lower numbers still.The top of that leaderboard is now separated by less than one WER point.That has a specific consequence for anyone choosing a model: rank is no longer the deciding variable.
License, language coverage, streaming support, and cost per audio-hour are.This roundup compares the field on all four.(function(){ window.addEventListener("message", function(e){ if(!e.data || typeof e.data.mtpAsrHeight !== "number") return; var f = document.
getElementById("mtp-asr-explorer"); if(f) f.style.height = e.data.
mtpAsrHeight + "px"; }); })(); First, a problem with the leaderboard number everyone quotes The Open ASR Leaderboard average is not a single fixed quantity, and the models currently listed side by side were not all scored the same way.Cohere’s 5.
42% is an average across eight English test sets, including TED-LIUM.That checks out: AMI 8.13, Earnings-22 10.86, GigaSpeech 9.34, LibriSpeech clean 1.25, LibriSpeech other 2.37, SPGISpeech 3.08, TED-LIUM 2.49, VoxPopuli 5.87 averages to exactly 5.42.ARK-ASR-3B’s 5.
04% is an average across seven sets.TED-LIUM is absent.The MOSS-Transcribe-preview-2B card states this explicitly: TED-LIUM is not currently part of the leaderboard run and is therefore excluded.TED-LIUM is one of the easier sets in the suite, so dropping it raises the average.
Recompute Cohere’s published per-dataset scores over the same seven sets ARK reports and Cohere lands at 5.84, not 5.42.Do the same to Granite Speech 4.1 2B and it moves from 5.33 to 5.65.
On a like-for-like basis ARK’s lead is larger than the headline numbers imply, not smaller — but the point is that you cannot subtract one published figure from another and get a meaningful answer.
Two further caveats belong on the same page: Some scores are openly leaderboard-fitted: The MOSS-Transcribe-preview-2B card states the model was fine-tuned with reinforcement learning on the Open ASR Leaderboard training splits.
That is disclosed, which is more than most, but it means the score measures the benchmark rather than the capability.
Private-track data reorders the board: Appen contributed held-back evaluation sets covering Australian, Canadian, Indian, and American accents in scripted and conversational conditions.
When those private sets are toggled on, zoom/scribe_v1 moves from #4 to #1 and the public-leaderboard leader drops a position.Models tuned for clean read speech degrade disproportionately on spontaneous conversational audio.Use the leaderboard to build a shortlist.Do not use it to pick a winner.
The accuracy tier Cohere Transcribe (2B, Apache 2.0, 14 languages) is the model that actually shipped into production.It has been downloaded over 620,000 times in the past month and has runtime support across transformers, vLLM, mlx-audio for Apple Silicon, a Rust port, and a WebGPU build.
It is a Conformer encoder with a lightweight Transformer decoder, trained from scratch.Cohere also ran human preference evaluation, where trained annotators scored transcripts for meaning preservation, hallucination, and named entities: a 61% average win rate, 78% against IBM Granite 4.
0 1B Speech and 64% against Whisper large-v3.The limitations section of its model card is unusually honest and should be read before committing.
There is no automatic language detection, no timestamps, and no diarization, and the model is eager to transcribe silence, so Cohere recommends prepending a VAD or noise gate.The repo is also gated behind a contact-information agreement despite the Apache 2.0 license.Granite Speech 4.
1 2B (2B, Apache 2.0) is the better pick if you need capability rather than a lower number.Six languages for ASR plus bidirectional speech translation, keyword-list biasing for names and jargon, punctuation and truecasing including German noun capitalization.Trained on 174,000 hours.RTFx 231.29.
IBM also ships two siblings: -plus adds speaker-attributed ASR and word-level timestamps, and -nar is discussed below.Canary-Qwen-2.5B (2.5B, CC-BY-4.0, English) pairs a FastConformer encoder with a Qwen3-1.
7B decoder and runs in two modes — pure transcription, or LLM mode where the decoder summarizes and answers questions about the transcript.5.63% WER at RTFx 418.Note that AMI was oversampled to roughly 15% of training data, which biases output toward verbatim disfluency-preserving transcripts.
That is a feature for legal work and a nuisance for meeting notes.Qwen3-ASR-1.7B (Apache 2.0) covers 52 languages and dialects — 30 languages plus 22 Chinese dialects — at 5.76%.It ships with a full inference toolkit and a separate forced-alignment model for timestamps in 11 languages.
For anything touching Mandarin or Chinese regional speech this is the obvious starting point.The throughput tier Accuracy across the top of the field now varies by about one WER point.Throughput varies by more than an order of magnitude, which means throughput usually decides the invoice.
Parakeet TDT 0.6B v3 (0.6B, CC-BY-4.0) is the throughput leader among multilingual open models at RTFx 3332.74 across 25 European languages with automatic language ID, handling up to 24 minutes in a single pass on an A100 80GB.It costs 6.32% WER — roughly one point more than Granite 4.
1 2B for roughly fourteen times the audio per GPU-second.Granite Speech 4.1 2B-NAR is the more interesting engineering result.It is non-autoregressive: it edits a CTC hypothesis in a single forward pass using a bidirectional LLM, reaching RTFx ~1820 on one H100 at batch size 128.
It gives up Japanese, speech translation, and keyword biasing to get there.Qwen3-ASR-0.6B keeps all 52 languages and reaches 2000× throughput at concurrency 128.The streaming tier A batch WER seems to be the wrong test for a streaming model, and the leaderboard scores them anyway.
Voxtral Realtime sits at 7.68% and Kyutai STT 2.6B at 6.40% — both below Whisper — and neither number tells you anything useful about their intended use.Voxtral Mini 4B Realtime 2602 (Apache 2.0, 13 languages) is a 3.
4B language model along with a 970M causal audio encoder trained from scratch, with sliding-window attention on both halves for effectively unbounded streaming.
Transcription delay is configurable in 80ms steps from 80ms to 1200ms, plus a standalone 2400ms option; Mistral recommends 480ms as the sweet spot and reports that at that setting it matches leading offline open models.It runs on a single 16GB GPU and had day-0 vLLM Realtime API support.
Kyutai STT (CC-BY-4.0) comes in two shapes: a ~1B English/French model with a 0.5s delay and a built-in semantic voice activity detector, and a 2.6B English-only model with a 2.5s delay.
For voice agents, the semantic VAD matters more than the transcription delay — it predicts when the speaker has actually finished, which is what governs perceived turn-taking latency.An H100 serves 400 concurrent streams in real time.The coverage tier Meta’s Omnilingual ASR (Apache 2.
0, corpus CC-BY) is not competing on WER and should not be evaluated as if it were.It covers 1,600+ languages natively and extends to 5,400+ through zero-shot in-context learning, built on a wav2vec 2.0 encoder scaled to 7B and pre-trained on about 4.3M hours.
The 7B LLM-ASR variant achieves character error rate below 10% on 78% of supported languages, including 500+ never previously served by any ASR system.Encoder sizes run from 300M to 7B.Meta also released the Omnilingual ASR Corpus covering 350+ underserved languages.Whisper large-v3 (1.
55B, MIT, 99 languages) has been overtaken on accuracy by roughly ten open models, and it remains the correct default for a large
Related
相關文章

選秀捲土重來,這回來的都不是真人了
抖音近期出現AI生成虛擬偶像的選秀短劇,如《星光108》和《12星練賽》,完全複製傳統選秀模式但選手皆非真人,引發熱潮。這類節目成本低、產出快,觀眾可投票決定成團命運,但也引發缺乏真實情感與監管不確定性的爭議。AI選秀可能預示娛樂產業結構性變革,未來或與真人選秀走向融合。

小紅書發佈《AI 治理規則公告》:鼓勵主動披露 AI 生成,反對 AI 洗稿、合成他人聲音、捏造新聞
首頁 > IT資訊>網絡 小紅書發佈《AI 治理規則公告》:鼓勵主動披露 AI 生成,反對 AI 洗稿、合成他人聲音、捏造新聞 2026/8/7 15:49:00 來源:IT之家 作者:潞源 責編:潞源 評論: 感謝IT之家網友 軟媒用戶1238620 的線索投遞! IT之家 8 月 7 日消息,小紅書官方昨天發佈《AI 治理規則公告》,明確 AI 賬號的治理原則。
我,用美圖Agent,一句話拍出AI短劇
美圖公司推出「美圖Agent」新功能,使用者只需輸入一句話即可自動生成AI短劇,大幅降低創作門檻。該功能整合自然語言處理與影像生成模型,能將指令拆解成分鏡腳本並產出連續畫面,目前支援多種風格且可免費試用基本功能。此舉顯示美圖從修圖軟體轉向AI內容創作平台的企圖心,目標鎖定短影音創作者與品牌行銷需求。
Grokipedia被曝數月未更新,AI百科項目編輯功能陷停滯
馬斯克推出的AI百科項目Grokipedia被揭露自今年4月起內容更新基本停滯,過去三個月內沒有任何條目完成更新,用戶編輯請求也長期未處理。調查顯示此問題普遍存在於各類頁面,與早期數分鐘內完成修改的效率形成明顯反差,且該平台曾因直接引用維基百科及爭議性來源而受質疑。

美國祖父母熱衷將孫輩寫進 AI 生成童書,引發父母輩大量反感
首頁 > 智能時代>人工智能 美國祖父母熱衷將孫輩寫進 AI 生成童書,引發父母輩大量反感 2026/8/6 17:44:33 來源:IT之家 作者:清源 責編:清源 評論: IT之家 8 月 6 日消息,美國一些祖父母正熱衷於把孫輩寫進 AI 生成童書,卻讓孩子父母大為反感,甚至引發家庭矛盾。據《連線》雜誌當地時間 7 月 29 日報道,美國各地不少父母陸續收到孩子祖父母送來的 AI 童書。

WorkBuddy 跑出來後,釘釘飛書放下了“入口”執念
WorkBuddy以AI代理為核心的新工具,促使釘釘與飛書放下過去對「入口」的執念,轉而將重心放在協作效率與場景落地。企業用戶不再迷信單一入口,更看重平台能否與其他系統順暢對接,讓AI在具體工作中產生實質效益。整體而言,競爭焦點從「圈住用戶」轉向「服務用戶」,AI能力與開放性成為下一階段的主導關鍵。