Soniox STT v6 新增代理文字輸入與迴音過濾功能,優化語音代理體驗

2026年11月3日 20:18
站內 AI 整理稿

Soniox has released Soniox STT v6, the latest generation of its speech-to-text API.Soniox STT v6 is a speech-to-text model that reads what a voice agent says while hearing the caller.It uses that text to recognize short replies and to drop the agent’s own voice.

The release ships as stt-rt-v6 for streaming and stt-async-v6 for files, across 60+ languages.TL;DR Size: Soniox STT v6 is a proprietary hosted model, no parameter count published.Runs on: Soniox cloud API only (WebSocket streaming and async REST).No self-hosted or on-device option disclosed.

Performance: Soniox calls it “significantly” more accurate than v5, but publishes no v6 numbers yet.Best: Price.$0.12/hour streaming and $0.10/hour async, with diarization and language ID bundled.Worst: Zero independent v6 results.Its v5 predecessor scored 1.

34% semantic WER on Pipecat, behind v4’s 1.25%.What problem does Soniox STT v6 solve?In a cascaded voice agent, STT usually hears only the caller.It never sees the question being answered.Short answers suffer most.In Soniox’s docs, “River Roast” becomes “River Road” and “a tow” becomes “a tour.

” The second problem is echo.Agent audio leaks back through speakerphones and laptops, gets transcribed as user speech, and the agent interrupts itself.How does agent text input work?You enable it with one flag in the start request: "enableagenttextinput": true.

It is only available on stt-rt-v6, not the async model.While the agent speaks, you stream its words on the same WebSocket as the caller’s audio.Each message is a small JSON frame: {"type": "agenttext", "text": "...", "endofsegment": true}.Timing matters.

Messages carry no timestamps, so the model places text where it arrives in the audio stream.Soniox recommends sending each piece 500 ms to 1 second before playback, paced by TTS timestamps.On barge-in, you flush what was already played, send endofsegment: true, and drop the unplayed rest.

The agent’s text never appears in the returned transcript.How does agent voice echo cancellation work?With agent text input on, v6 knows what the agent is saying.It uses that to separate leftover agent audio from caller speech and filter it out.

It keeps listening during playback, so callers can still interrupt.It does not replace acoustic echo cancellation.It handles what your existing AEC leaves behind, so keep AEC on.What else changed in v6?Better voice typing: numbers, currencies, units, dates, IDs, names and specialized terms.

Spoken commands like “period” or “new line” are written as words, so your app applies them.Improved meeting transcription and speaker diarization, live or recorded.Stronger accents, code-switching and language switching within a sentence.There is one formatting change to test before upgrading.

v6 writes “15 dollars and 20 cents” as spoken, not “$15.20”.Hyphens in codes appear only when spoken.window.addEventListener("message",function(e){if(e.data&&e.data.sx6h){var f=document.getElementById("sx6-frame");if(f&&e.source===f.contentWindow)f.style.height=e.data.

sx6h+"px";}}); How does Soniox compare on benchmarks?Soniox has not published v6 accuracy or latency numbers.Its benchmarks page still reports v5 on the open-source Pipecat STT benchmark.It uses 1,000 real-world samples and measures semantic WER plus time to final segment (TTFS).

On it, stt-rt-v5 scores 1.34% semantic WER, 83.3% perfect transcripts and 260 ms median TTFS.Its P95 latency is 305 ms.Azure posts the lowest WER mean at 1.21%, but at 1,016 ms median latency.FeatureSoniox stt-rt-v6AssemblyAI Universal-3.

5 Pro RealtimeDeepgram Nova-3ElevenLabs Scribe v2 RealtimeModel sizeNot disclosedNot disclosedNot disclosedNot disclosedStreaming languages60+1860+ (Nova models)90+Streaming price / hour$0.12$0.45$0.46 mono, $0.55 multi$0.

39Agent-side text contextYes, timed agenttextYes, agentcontextNot disclosedNot disclosedModel-level agent echo filteringYesNot disclosedNot disclosedNot disclosedDiarization costIncludedNot disclosed+$0.0020/minNot disclosedPipecat semantic WER mean1.34% (v5; v6 untested)1.44%1.

71% (nova-3-general)3.16%Pipecat perfect transcripts83.3% (v5)84.7%76.5%81.3%Pipecat TTFS median260 ms (v5)282 ms247 ms281 ms Pipecat figures from the Pipecat STT benchmark README.Soniox numbers are for v5, since v6 has not been benchmarked yet.Is Soniox really the first?

Soniox calls v6 the first model that knows what your voice agent is saying.That claim needs a qualifier.AssemblyAI shipped agent context in Universal-3.5 Pro Realtime in July 2026.It also feeds the agent’s replies into streaming STT.The clearer difference is echo.

Soniox’s docs describe filtering leaked agent audio using that text.AssemblyAI’s context docs describe no such filtering.Deployment, pricing and migration v6 is a drop-in swap: change the model name to stt-rt-v6 or stt-async-v6.The v5 models are deprecated and will be removed on December 15, 2026.

After that, v5 requests route to v6 automatically.Pricing is token-based.Soniox lists about $0.12/hour streaming and $0.10/hour async.Agent text is billed as input text tokens, at $4.00 per 1M on real-time.Key Takeaways Soniox STT v6 reads the agent’s text to transcribe caller replies.

Echo filtering removes leaked agent voice, on top of normal AEC.Streaming costs $0.12/hour, with diarization included.No v6 benchmark numbers exist yet; v5 scored 1.34% on Pipecat.v5 models retire December 15, 2026, with automatic routing to v6.

Check out the Soniox STT v6 announcement, the agent text input docs and the v6 changelog.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?now you can join us on telegram as well.

Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?Connect with us The post Soniox STT v6 Adds Agent Text Input and Echo Filtering for Voice Agents appeared first on MarkTechPost.

Related

相關文章

雷峰網模型更新

拓竹年度機皇 H3C 發佈:9 頭閃切、6 秒換頭,開啟多色多材料新時代

2026 年 11 月 3 日,拓竹正式發佈第三代旗艦 3D 打印機 H3C,標準套裝起售價 16,499 元,首發期間直降 1,000 元,疊加國家補貼後到手價可低至 13,999 元。H3C 以 Swaptek™ 多頭閃切系統、頂置一體化 AMS 3H 供料系統與可變線徑擠出機三大核心技術的協同,一舉在消費級市場實現了兩項行業首創——穩定打印最軟耗材 75A TPU,並讓疊色打印真正可用。

9 小時前
智東西模型更新

Gartner發佈2027十大技術趨勢:非文本AI排第一,Harness是未來1-3年重點

作者 | 楊京麗 編輯 | 李水青 11月3日報道,今日,知名研究機構Gartner的研究副總裁高挺(Arnold Gao)在媒體交流會上,圍繞Gartner近期發佈的《2027年十大戰略技術趨勢》報告進行詳細解讀。報告認為,2027年企業需要重點關注的十大技術趨勢包括大型定量模型、語音推理模型、世界模型、AI上下文平臺、編碼智能體框架、AI智能體身份、自主式暴露修復、主權技術、可拋棄型應用和溼件即服務。

12 小時前
雷峰網模型更新

騰訊12.8億用戶蟬聯中國互聯網第一,綠泡泡月活破1.5億,手遊top10獨佔8款

本文作者: Nemo 2026-11-03 18:59 導語:短劇業務是本次報告的關注重點。11 月 3 日,QuestMobile發佈最新《中國移動互聯網秋季大報告》。報告顯示,截至 2026 年 9 月,騰訊控股以 12.80 億去重總用戶量(APP + 小程序)位列中國互聯網公司用戶規模榜首,第九年蟬聯榜首,霸主地位穩固。

13 小時前
智東西模型更新

實測阿里版Muse:千問Go 7×24小時在線,幫我逛淘寶、盯大麥

AI應用風向標(公眾號:ZhidxcomAI) 作者|畢偉豪 編輯|漠影 如果有這樣一個AI,它有一部手機和一臺電腦在雲端24小時運轉等你發號施令,能登錄你的淘寶、高德、大麥,能幫忙挑選商品,還能在雲端電腦上開發遊戲,甚至可以一句話做出應用,你會拿它來做什麼?

14 小時前