AssemblyAI Ships AssemblyAI-TTS-1: A $15 per 1M Character Text-to-Speech API for Voice Agents
AssemblyAI has released AssemblyAI-TTS-1, its first text-to-speech model, now generally available.The AssemblyAI-TTS-1 text-to-speech API targets voice agents running on live phone calls.In that setting, latency and pronunciation decide whether a caller stays on the line.
Pricing is $15 per 1M characters, with no annual contract and no concurrency tier to buy.For developers already using AssemblyAI speech-to-text, it closes the voice loop with one vendor.TL;DR Size: It is a hosted API model.Runs on: AssemblyAI’s cloud only, in the US (us-east-1) or EU (eu-north-1).
No open weights or on-prem option.Any client with HTTP or WebSocket works.Performance: Ties ElevenLabs v4 on entity accuracy in AssemblyAI’s tests, at under 1/5 of its price.Best: 47 ms median time to first byte across 6 models in AssemblyAI’s API test (self-reported).
Worst: 159 ms median streaming latency on Cekura’s independent benchmark, 8th of 19 timed models.Bottom line: Best: $15 per 1M characters with unlimited concurrency.Worst: no SSML, speed control, pronunciation dictionaries or emotion tags yet.What is AssemblyAI-TTS-1?
AssemblyAI-TTS-1 is a streaming text-to-speech model from AssemblyAI that turns agent replies into speech for live calls.It was trained on millions of hours of audio, including real conversational data.Most TTS models represent audio as discrete tokens.
AssemblyAI says TTS-1 operates on continuous audio representations instead.The AssemblyAI claims this improves realism and cuts time to first spoken audio.The launch includes a library of 4,000+ voices and instant voice cloning.
A clone needs a short recording and a confirmation of the speaker’s permission.The clone in the launch post used 24 seconds of audio.Six languages are supported at launch: English, Spanish, French, German, Italian and Portuguese.How do developers integrate AssemblyAI-TTS-1?
There are 3 interfaces: an HTTP API, a WebSocket API and an OpenAI-compatible route.The WebSocket session keeps one connection per conversation and accepts a cancel message for barge-in.Output is mono PCM, mu-law or A-law, at 8 kHz to 48 kHz.
24 kHz PCM is the native format; telephony stacks can request 8 kHz mu-law directly.Word timestamps are included.AssemblyAI also published LiveKit and Pipecat reference agents.How does AssemblyAI-TTS-1 perform on benchmarks?
AssemblyAI tested TTS-1 against 5 models on 4 English sets, using 50 matched cloned voices.All figures below are self-reported, from an eval dated October 28, 2026.Entity accuracy (580 hard targets such as phone numbers and codes): 93.7%, vs ElevenLabs v4 93.6%, Cartesia Sonic 3.6 82.
5%, ElevenLabs Flash v2.5 68.0%.Word accuracy: 99.0% on Seed-TTS and LibriSpeech sentences.Predicted MOS: 3.85, behind Inworld TTS-2 Flash at 3.88 and ahead of Sonic 3.6 at 3.82.Median time to first byte: 47 ms.Flash v2.5 took 119 ms, Sonic 3.6 143 ms, Inworld TTS-2 Flash 244 ms.Other: 85.
5 TTSDS prosody score and 0.64 speaker similarity for cloned audio.Independent results are more mixed.On Cekura’s benchmark of 27 models, TTS-1 scored 81.5% reading accuracy and 4.50 naturalness.Its median streaming latency, timed from the last word sent, was 159 ms.
Inworld TTS-2 Flash posted 45 ms and 93.2% accuracy there, at the same $15 price.AssemblyAI also cites a 1.7% word error rate on Coval’s leaderboard.It reports a top-10 debut in Artificial Analysis’ controlled-voice arena.
Play ‹ Back Next › Entity accuracy Median TTFB (AssemblyAI test) Streaming latency (Cekura) Reading accuracy (Cekura) Spoken minutes per month: 10,000
Assumes 600 characters per minute of phone speech, the figure AssemblyAI cites as typical. List prices per 1M characters: AssemblyAI-TTS-1 $15, Inworld TTS-2 Flash $15 on demand, ElevenLabs Flash v2.5 $40, ElevenLabs v4 $80. Concurrency limits are not priced in. No SSML or speed control LAUNCH GAP
The WebSocket API has no speed, pitch, emotion or style parameter, and neither API accepts SSML. Punctuation and written fillers like "um" still shape delivery. No pronunciation dictionaries COMING SOON
Custom pronunciation dictionaries and emotion tags are announced but not shipped. Cartesia Sonic 3.6 already offers custom pronunciations. 6 languages COVERAGE
English, Spanish, French, German, Italian and Portuguese. ElevenLabs Flash v2.5 lists 32 and Cartesia Sonic 3.6 lists 44. Latency depends on method CHECK IT
About 90 ms advertised, 47 ms median in AssemblyAI's own test, 159 ms median streaming latency on Cekura (timed from the last word sent). Instant cloning only LAUNCH GAP
Pro (fine-tuned) voice cloning is not available yet. Instant clones need a short clip and speaker permission. Cloud only DEPLOYMENT
US (us-east-1) and EU (eu-north-1) hosts at the same price.No on-prem option is announced.Tap a card to expand it.Sources: AssemblyAI launch post, docs and pricing; Cekura TTS benchmark; vendor pricing pages.Checked Oct 29, 2026.Built by Marktechpost (function(){ var R=document.
getElementById('mtp-aai-tts1');if(!R)return; function resize(){try{parent.postMessage({mtpEmbed:'aai-tts1',h:R.offsetHeight+40},'*')}catch(e){}} R.querySelectorAll('.tab').forEach(function(t){t.addEventListener('click',function(){ R.querySelectorAll('.tab').forEach(function(x){x.classList.
remove('on')});t.classList.add('on'); R.querySelectorAll('.pane').forEach(function(p){p.classList.toggle('on',p.getAttribute('data-p')===t.getAttribute('data-t'))}); if(t.getAttribute('data-t')==='bench')draw(cur);setTimeout(resize,60);});}); var steps=['Your agent LLM write
Related
相關文章
香港大學發佈全球首個KYA報告關注智能體信任建設,九類企業實踐獲收錄
11月3日,香港大學副校長汪揚教授與香港大學經管學院楊宏副教授代表香港大學KYA課題組,在2026年香港金融科技周 x StartmeupHK創業節發佈全球首個KYA(Know Your Agent)領域報告《KYA:智能體信用體系研究報告》。報告聚焦智能體參與真實經濟活動後的身份、授權、信用與責任問題,結合109份從業者有效問卷及包含Stripe、螞蟻數科等近十個企業案例,提出智能體成熟度模型、KYA框架和智能體發展指數,並進一步探討“智能體信任資本”的形成及其經濟價值。“沒有KYA,就沒有智能體經濟。
算力成本高昂難以承受?傳SpaceX悄悄削減Grok Bot配額,馬斯克坦言營利失衡
傳SpaceX悄悄削減Grok Bot配額,馬斯克坦言營利失衡發布於AI新閒資訊時間 :Nov 3, 2026閱讀 :1分鐘近日,據外媒報道,多名用戶在社交平臺上反映,SpaceX 在上週末悄然對旗下熱門的 Grok Bot 進行了用量配額調整,不少用戶的額度直接被縮減了一半。
Grok Bot暗暗砍額度,馬斯克承認:成本難持續
編譯 | 黃菲 編輯 | 江宇 11月3日消息,據TechCrunch報道,近日,SpaceXSI旗下AI Agent產品Grok Bot因服務成本過高,開始收緊用戶使用額度。特斯拉CEO、SpaceXSI創始人兼CEO埃隆·馬斯克(Elon Musk)11月2日在X上回應稱,Grok Bot的服務成本相對於收入而言已經高得難以持續,此前用戶反饋的額度異常消耗並非系統故障。
小米斬獲烏鎮峰會雙料大獎:小米集團獲“傑出貢獻獎”,小米具身基座模型獲“領先科技獎”
11月3日,小米方面披露,小米集團獲得2026世界互聯網大會“傑出貢獻獎”創新突破類獎項,該獎項旨在表彰全球互聯網相關領域作出傑出貢獻的個人和企業。同時,小米機器人業務“面向規模化落地的通用機器人操作基座模型關鍵技術”獲大會“領先科技獎”,該獎項旨在獎勵全球年度最具領先性的互聯網科技成果。峰會期間,小米還對外披露了機器人業務在工業製造和家庭場景的兩項最新落地進展。
當三體IP開始連接 AI 和硬科技,到底在探索什麼?
“不要回答!不要回答!!不要回答!!!”《三體》中,來自宇宙深處的信號曾讓人類面臨重大抉擇,二十年後,當 AI 可以理解文本、生成 3D 模型,甚至以智能體的形式與人對話,人類能否藉助這些技術,主動進入科幻作品所描繪的世界?10月24日至25日,在北京舉辦的2026三體日·脫水浸泡嘉年華上,三體宇宙(三體IP的版權方和運營方)開始嘗試回答這個問題。
尋找AI時代的下一個黑馬:安全創客匯重磅升級為AI創客匯
11月3日,在2026年世界互聯網大會烏鎮峰會期間,奇安信宣佈:國內網絡安全領域最具影響力的專業創投平臺之一——安全創客匯,即日起正式升級為“AI創客匯”。新平臺將延續過去嚴苛的選拔機制與創投生態,而賽道邊界將徹底打開——由聚焦網絡安全領域,升級為更加廣闊的AI創新與應用領域,旨在發現和挖掘那些在AI浪潮中搏擊的“創新黑馬”。 本次升級不僅是名稱的更迭,更是一次順應時代潮汐的戰略躍遷:一個以安全為底色的專業創投平臺,正式向整個AI時代的創新者發出邀請函。