IBM AI Releases Granite Speech 5.0 2B for Multilingual Transcription and Translation
IBM has released Granite Speech 5.0 2B, a new open speech-language model for transcription and translation.Granite Speech 5.0 2B is a 2B-parameter model from IBM that turns speech into text in 6 languages.It ships under Apache 2.0.
IBM also updated 2 existing models: the edge-focused Turbo CTC and the diarization-focused 4.1 2B Plus.For developers, the release covers accurate transcription, fast on-device transcription and speaker-attributed transcripts.TL;DR Size: 2B parameters, dense.
LLM backbone uses YaRN extension to 16k positions.IBM recommends audio segments of up to about 2 minutes.Runs on: GPU via Transformers or vLLM, Apple Silicon via mlx-audio, local CPU/Mac via llama.cpp GGUF (Q80 recommended).Performance: #2 open-weight model on the Open ASR Leaderboard, 5.
68% average English WER.Best: 0.99% WER on LibriSpeech Clean.Worst: 13.79% WER on the leaderboard’s private conversational set.How does Granite Speech 5.0 2B work?The model has 3 parts, per the model card.A speech encoder of 16 Conformer blocks is trained with CTC.
It uses block attention over 4-second audio blocks.A 2-layer window q-former then projects and downsamples the acoustic embeddings.Total downsampling is 10x, so the LLM sees embeddings at 10 Hz.The LLM is an intermediate checkpoint of granite-4.0-1b-base.
IBM extended it to 16k positions with YaRN and fine-tuned it with LoRA adapters.Training used 390,000 hours of public audio plus synthetic data.The synthetic sets target Japanese ASR, keyword biasing and translation.Training took 40 days on 8 H100 GPUs.What is new versus Granite Speech 4.1 2B?
Language ID prompting: name the input language in the prompt to steer transcription.Keyword lists up to 2,000 terms: bias output toward product names, people and acronyms.Punctuation and capitalization on request: capitalization F1 runs from 90.16 to 99.51 across test sets.
Robustness: better handling of noise, reverberation and distant microphones.How does Granite Speech 5.0 2B perform on benchmarks?On the Open ASR Leaderboard, IBM’s chart shows a 5.68% average English WER.That average covers 9 public and 2 private test sets, as of October 21, 2026.Only Qwen3-ASR-1.
7B scores better, at 5.40%.Note a source conflict.IBM’s blog reports 5.06% instead.That figure is unofficial, dated October 15, and averages public short-form sets only.Per-set results range widely.The model scores 0.99% on LibriSpeech Clean and 2.21% on LibriSpeech Other.It scores 13.
79% on the private conversational set.On the noisy FFASR leaderboard, it ranks #4 of 42 at 14.80% average WER.Qwen3-ASR-1.7B scores 13.41% there.Multilingual CommonVoice WER is 2.60% for Portuguese and 3.50% for Spanish.Japanese is the weakest language at 10.74%.
For translation, X-to-English CoVoST BLEU reaches 53.6 for Portuguese and 40.1 for German.English-to-Mandarin was not evaluated.Keyword biasing shows the clearest gain.On Earnings-22, keyword F1 rises from 67.2 to 90.1 with correct keyword lists.
With 2,000-term lists mixing correct and wrong terms, it still reaches 82.8.window.addEventListener("message",function(e){if(e.data&&e.data.gs5h){var f=document.getElementById("gs5frame");if(f)f.style.height=e.data.gs5h+"px";}}); How does it compare with other open ASR models?
FeatureGranite Speech 5.0 2BQwen3-ASR-1.7BCohere Transcribe 03-2026Canary-Qwen-2.5BSize2B2.35B (Hub count)2.07B (Hub count)2.5BLicenseApache 2.0Apache 2.0Apache 2.0 (gated)CC-BY-4.
0ASR languages630 + 22 Chinese dialects14English onlySpeech translationYesNot disclosedNot disclosedNoOpen ASR avg WER (Oct 21, 2026)5.68%5.40%5.77%5.94%FFASR avg WER (Oct 18, 2026)14.80%13.41%15.
03%Not disclosedKeyword biasingUp to 2,000 termsNot disclosedNot disclosedNot disclosedLong audio~2 min segmentsLong audio supportedNot disclosed40 s max in training *Leaderboard averages as charted in IBM’s model card from the Open ASR and FFASR leaderboards.What changed in Turbo CTC and 4.
1 2B Plus?Granite Speech 5.0 Turbo CTC keeps its 470M footprint.It now transcribes 7 languages with native punctuation and capitalization.IBM compiled one Conformer block and reused its graph across the stack.That lifted throughput to 19,870 RTFx, up from about 12,600 at launch.
The updated Granite Speech 4.1 2B Plus is a drop-in weight update.Average timestamp shift falls from 210.86 to 98.54.Long-form WER drops from 13.53 to 10.22.Biased-keyword WER falls from 11.79 to 6.48.How can developers deploy it?Granite Speech 5.0 2B runs in Transformers, vLLM, llama.
cpp and mlx-audio.For GGUF, IBM recommends Q80.Lower-bit quantizations lose accuracy on audio longer than about 1 minute.Key Takeaways #2 open-weight model on the Open ASR Leaderboard at 5.68% WER.2B parameters, Apache 2.0, runs on GPU, Mac and local CPU.
2,000-term keyword biasing across all supported languages.Turbo CTC reaches 19,870 RTFx and now covers 7 languages.Qwen3-ASR-1.7B still leads on accuracy and noisy audio.Check out the model card, IBM blog and Granite Speech paper.All credit goes to the researcher of this project.
Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?now you can join us on telegram as well.Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?
Connect with us The post IBM AI Releases Granite Speech 5.0 2B for Multilingual Transcription and Translation appeared first on MarkTechPost.
Related
相關文章
科大訊飛首發星火語音基座大模型 SparkAudio 1.0
它把機器翻譯、語音識別、語義理解這幾樣本領擰進同一個模型裡,讓基礎語音能力整體往上抬了一截。在官方演示裡,SparkAudio1.0借一段電影片段秀出了它的"耳朵"有多尖:不僅能精準分辨聲音內容、背景和說話人的性別,還能對場景做出準確判斷。
螞蟻數科發佈LingDT-Decision-1.0 準確率超過微軟和JEV等決策模型
Jev1.13.等熱門決策模型,LingDT-Decision-1.0的27B版本在同參數模型中取得最高準確率。專為決策任務設計,Token消耗直降超90%,更快更準在企業實際應用中,存在大量高頻的決策類任務。例如,在客服場景中,當收到“這個訂單已經三天了還沒發貨,請儘快處理。
對標大熒幕級標準:火山引擎4K視頻模型首批試用花落20家全球頂級工作室
作為Seedance2.5系列中的最強版本,該4K模型在保持畫面細節更清晰的基礎上,主打更細膩自然的人物表演,並實現了更高精度的參考生成與編輯一致性。目前參與試用的20部作品中,最早將於下個月迎來衛視S級IP播出,同時還涵蓋全球大 IP電影項目。
谷歌雲豪擲 96 萬塊 Rubin GPU:Vera Rubin 平臺鋪向多站點,A5X 實例上線
在 AI 算力爭奪白熱化的當下,這一數字把下一代加速器規模直接拉到百萬級,谷歌要在雲市場軍備競賽裡搶佔身位。與擴軍同步,Google Cloud 基於英偉達 Vera Rubin NVL72 機架級系統的 A5X 實例已發佈。這套實例採用英偉達 ConnectX-9 SuperNIC,配合谷歌雲 Virgo 網絡與第四代液冷技術,定於下月推出。
千萬級醫療AI訂單,智譜中標!
智東西 作者 | 孫小雯 編輯 | 程茜 智東西10月22日報道,昨日,廈門市健康醫療大數據中心(廈門市醫藥研究所)“人工智能醫療大模型底座與應用工程一期”項目公佈中標結果,中標供應商為北京智譜華章科技股份有限公司(簡稱:智譜),中標金額為1058萬元。 此前9月29日,該項目招標公告發布,預算金額及最高限價均為1080萬元。採購標的為1套行業應用軟件開發服務。 ▲該項目採購預算為1080萬元(圖源:中國政府採購網) 據公開披露的採購需求,項目建設內容包括:醫療大模型基礎支撐平臺、數據安全協同與聯邦學習能力、智能心理健康服務應用,以及數據資產管理和安全運維體系。其中,大模型平臺需具備模型統一管理、服務調用、訓練測評、運行監控和算力調度能力;心理健康服務應用覆蓋篩查、導診、幹預、隨訪等場景。 ▲該項目技術服務要求(圖源:中國政府採購網) 今年,智譜已獲得多個政企項目訂單。智東西根據公開信息不完全統計,截至10月22日,智譜及旗下公司已中標或成交至少21個政企項目,其中已披露金額超過1000萬元的有3個。8月25日,浙江智譜新篇科技有限公司以4000萬元中標杭州上城區“Token創新支持行動”項目;2月11日,智譜以1090萬元中標中國氣象局公共氣象服務中心“智慧短臨預警氣象服務大語言模型”項目。 此外,6月16日,深圳市智慧城市科技發展集團有限公司公示“基於國產大模型的全球科創分析服務項目”中標候選人,智譜以9390萬元報價位列第一中標候選人。 從商業化進展來看,智譜今年上半年的收入已超過2025年全年。據該公司8月31日發佈的2026年中期業績,上半年收入約9.54億元,同比增長399.7%。其中,開放平臺及API業務收入約8.25億元,佔總收入的86.5%,成為主要收入來源;本地化部署收入佔比則從2025年全年的73.7%降至13.5%。
八部門印發產業基礎"十五五"規劃,佈局通用與行業大模型
規劃提出,要加強產業基礎領域的通用大模型和行業大模型研發佈局,讓工業機理與智能體決策模型相互融合,發展一批"智能原生"的基礎產品,並培育模型即服務、智能體即服務等新業態。在落地路徑上,規劃要求加快人工智能向產品研發、設計仿真、中試驗證、生產運營等全環節滲透,把過程管理、分析預測、決策執行的智能化水平整體抬上去,從而加速產業基礎創新的迭代節奏。