Gradium Open-Sources Phonon, a 31M-Parameter On-Device TTS Model Under Apache 2.0

2026年10月22日 16:56
站內 AI 整理稿

Gradium has open-sourced Phonon, a family of small text-to-speech models built to run on the device.The Gradium Phonon on-device TTS model comes in 31M and 40M sizes.The English Phonon 31m ships under Apache 2.0 and fits in a 64.5 MB file.

Developers get natural speech with no cloud call, no GPU and no per-character bill.TL;DR Size: 31M parameters (excluding the audio tokenizer), 64.5 MB q8 GGUF, 24 kHz mono output.Phonon 40m: 40M, 74.6 MB.Runs on: CPUs, phones, Raspberry Pi 5, browsers (WASM, WebGPU) and NVIDIA GPUs.No GPU required.

Performance: top English Elo among open models Gradium tested; about 7 ms to first audio on CPU.Best: 1.70% WER on a 500-sentence hard set, versus 3.50% for Kokoro (Gradium’s eval).Worst: 0.51% Seed-TTS LLM WER, behind Kokoro (0.45%) and Magpie (0.46%).What is Gradium Phonon?

Phonon is an open-weight TTS family from Gradium, a Paris voice AI company spun out of Kyutai.It generates speech locally on phones, laptops, boards and browsers.The family has three models: Phonon 31m: English only, 37 built-in voices, Apache 2.0.

Phonon 40m: 1 model per language (English, French, German, Spanish, Portuguese), CC BY-NC 4.0.Phonon 40m multilingual: all 5 languages in 1 model, 102 voices, CC BY-NC 4.0.How does Phonon work?Phonon uses a causal transformer backbone.Its prefix combines text and speaker embeddings.

A SentencePiece tokenizer with a 4,000-token vocabulary reads raw text, with no phoneme conversion.The backbone generates 1 latent vector per 80 ms frame.A flow-matching head turns that vector plus noise into an audio embedding in a single step.

A smaller variant of Kyutai’s Mimi decoder then outputs 24 kHz PCM audio.A separate end-of-speech head decides when to stop.Phonon 31m uses 6 transformer layers, width 512 and 8 attention heads.Phonon 40m uses 9 layers at the same width.Both are distilled from a larger Phonon teacher.

Training ran on an NVIDIA H100 cluster with NCCL and CUDA Graphs.The work builds on Kyutai’s Continuous Audio Language Models research and Pocket TTS.STEP 2SentencePiece

STEP 3Causal transformer

STEP 4Flow-matching head

STEP 5Mimi decoder Back Next step Stream frames Each bar is 1 latent frame = 80 ms of 24 kHz audio Hard-set WER (lower is better) English Elo (higher is better) Seed-TTS WER Time to first audio

6.9 ms Speed vs real time

29.9x Gradium blog rows are Phonon 31m; partner and press-release rows do not name the variant. Higher "x real time" means more seconds of audio per second of compute. Measured by Gradium and launch partners. Where Phonon 31m leads

1.70% hard-set WER vs 3.50% for Kokoro

6.9 ms to first audio on a MacBook Air M5 CPU

3.7x real time on a Raspberry Pi 5

Apache 2.0 weights, tokenizer and voices Where it falls short

0.51% Seed-TTS WER, behind Kokoro at 0.45%

English only at 31M; 40m models are CC BY-NC

Prosody resets between sentences on long text

All benchmarks are run by Gradium Sources: gradium.ai/blog, huggingface.co/gradium · self-reported numbersBuilt by Marktechpost (function(){ var R=document.getElementById('mtp-phonon'); function send(){try{parent.postMessage({mtpFrameHeight:R.offsetHeight+40,id:'mtp-phonon'},'*')}catch(e){}} R.

querySelectorAll('.tab').forEach(function(t){t.addEventListener('click',function(){ R.querySelectorAll('.tab').forEach(function(x){x.classList.remove('on')});t.classList.add('on'); R.querySelectorAll('.panel').forEach(function(p){p.classList.remove('on')}); R.querySelector('#p-'+t.dataset.t).

classList.add('on'); if(t.dataset.t==='bench')drawBars(cur); setTimeout(send,60);});}); R.querySelectorAll('.mc').forEach(function(c){c.addEventListener('click',function(){ R.querySelectorAll('.mc').forEach(function(x){x.classList.remove('on')});c.classList.add('on'); document.

getElementById('fam-d').textContent=c.dataset.d;setTimeout(send,30);});}); var steps=['Input text plus a speaker embedding.The voice can be built-in, cloned or designed in Gradium Studio, then run locally.', 'Raw text becomes tokens from a 4,000-token SentencePiece vocabulary.

No phoneme conversion, so new languages are easier to add.', 'A causal transformer (6 layers, width 512, 8 heads in 31m) generates 1 latent vector per 80 ms frame, autoregressively.', 'A flow-matching head turns each latent plus noise into a continuous audio embedding in a single step.

An end-of-speech head decides when to stop.', 'A smaller variant of Kyutai\'s Mimi decoder converts embeddings into 24 kHz PCM audio, streamed while generation continues.']; var si=0,sts=R.querySelectorAll('.st'); function setStep(i

Related

相關文章

智東西生成式AI

全國產芯片訓練的大模型來了!百萬上下文,價格比DeepSeek V4.1 Flash更低

作者 | 程茜 編輯 | 心緣 10月22日報道,今日,科大訊飛發佈數個大模型及AI應用新成果,包括端雲一體大模型訊飛星火X2.6、語音基座模型SparkAudio 1.0、星火具身多模態交互技術、WinWork數字員工平臺、超級AI教師助手訊飛星光等。 其端雲一體訊飛星火X2.6基座模型基於全國產算力完成能力升級,包含雲端的293-A30B模型及端側的X2.6-4B模型,後一模型已開源。 雲端模型293-A30B支持百萬token上下文,輸入價格為0.9元/百萬tokens,輸入緩存命中價格為0.

4 小時前
智東西生成式AI

法律AI獨角獸再融37億,英偉達曾投,ARR半年翻倍

編譯 | 孫小雯 編輯 | 程茜 10月22日消息,昨日,瑞典法律AI獨角獸Legora宣佈完成5.5億美元(約合人民幣36.96億元)E輪融資,投後估值達到88億美元(約合人民幣591.36億元)。該公司計劃將資金用於拓展北美、歐洲及亞太市場,並繼續開發面向法律工作的智能體。

7 小時前
雷峰網生成式AI

又一國產決策模型發佈!準確率超過微軟和Jev等決策模型

Jev 1.13.等熱門決策模型,LingDT-Decision-1.0的27B版本在同參數模型中取得最高準確率。(圖注:LingDT Decision 的4B/27B 版本的優勢區域,覆蓋了相關尺寸包括Jev、MS Decision、GLiDE等決策模型,表現出極強的綜合性價比) 專為決策任務設計,Token消耗直降超90%,更快更準 在企業實際應用中,存在大量高頻的決策類任務。

7 小時前
雷峰網生成式AI

《2026千川乘方投放寶典》出爐!助力商家迎戰雙11

抖音興趣電商逐漸步入精細化經營新階段,電商營銷的成本構成也日趨多元,單純以廣告消耗評估投放效果,已經很難還原品牌真實經營收益。為幫助商家建立全鏈路視角下的投放經營體系,進一步釋放GMV增長潛力,《2026千川乘方投放寶典》正式出爐!寶典以千川乘方體系為核心,系統梳理了從投放升級、素材供給、達人營銷到轉化增效等完整落地路徑,覆蓋日常經營、新品冷啟、大促爆發關鍵階段,助力商家把握節點機遇,找到生意增長的更優解。

7 小時前