Alibaba Qwen Team Releases Qwen3.8-LiveTranslate: A Real-Time Interpretation Model That Cuts Average Lag to 2.3 Seconds Across 60 Languages

2026年9月20日 06:46
站內 AI 整理稿

Qwen has released Qwen3.8-LiveTranslate, its next-generation real-time simultaneous interpretation model.It listens to live speech, with optional video frames, and returns translated text and speech while the speaker is still talking.The core change is a new Interleave architecture.

Qwen reports gains in faithfulness, fluency, and conciseness, with average lagging (LAAL) dropping from 2.8 seconds to 2.3 seconds.The release also adds real-time speaker diarization, synchronized bilingual display, and long-context disambiguation.Deployable?Yes, as a hosted API.

It is live on Alibaba Cloud Model Studio and QwenCloud as qwen3.8-livetranslate-flash-realtime over WebSocket.What Changed Under the Hood Simultaneous interpretation is a tradeoff.Waiting longer gives the model more context.Speaking sooner cuts delay for the listener.Qwen3.

8-LiveTranslate rebuilds this loop with an Interleave architecture.The latency metric here is LAAL, or Length-Adaptive Average Lagging.It measures how far the translation trails the source speech on average.It also avoids rewarding systems that over-generate output.A drop from 2.8 seconds to 2.

3 seconds is roughly an 18% cut in average lag.QwenCloud team describes the model as the real-time version of Qwen3.8-LiveTranslate-Flash.It builds on the Qwen-Omni stack, large-scale multimodal data, cross-language and cross-modal alignment, and visual enhancement.

The Flash model also supports offline audio and video translation.Three New Capabilities Real-time speaker diarization: The model distinguishes speakers in multi-party speech.It also preserves each speaker’s voice through more stable voice cloning.

The API exposes cloning modes, including an always mode that re-clones before each response for multi-speaker sessions.Synchronized bilingual display: Source text and translation appear on screen together.In the API, source transcription streams as its own events next to the translation stream.

Long-context disambiguation: The model uses conversation history to resolve names and terminology.A name introduced early in a meeting stays consistent later in the translation.Try the explainer below.

It walks through the interleaved stream, speaker tagging, context disambiguation, language coverage, and session cost.#mtp-qwen38-lt-wrap iframe{display:block!important;width:100%!important;border:0!important;background:#120F2A!

important;}#mtp-qwen38-lt-wrap p:empty,#mtp-qwen38-lt-wrap hr,#mtp-qwen38-lt-wrap del,#mtp-qwen38-lt-wrap s{display:none!important;} (function(){var f=document.getElementById('mtp-qwen38-lt-frame');window.addEventListener('message',function(e){if(!e.data||!e.data.mtpLT||e.source!==f.

contentWindow)return;f.style.height=e.data.h+'px';});})(); Languages, Inputs, and Vision The model understands 60 languages.It can speak 29 of them, returning audio plus text.The remaining 31 return text only.

Speech output covers Chinese, English, Arabic, German, French, Spanish, Japanese, Korean, Hindi, and others.Inputs are audio and optional images.Outputs are text and audio.Visual cues such as lip movements, gestures, and on-screen text help in noisy rooms and with ambiguous words.

The docs recommend sending no more than 2 images per second.Teams can also set hotwords.These map source terms to fixed target translations.The docs recommend configuring no more than 1,000 hotwords.

API, Pricing, and Limits Developers connect through the WebSocket Realtime API with the model ID qwen3.8-livetranslate-flash-realtime.The default turn detection type is speakerdetection.Clients stream audio continuously and receive server-generated responses.

Default audio is 16 kHz PCM in and 24 kHz PCM out.The default voice is Tina.Set session.outputmodalities to text only, or text and audio.Always send session.finish before closing, or the final segment is lost.Singapore list pricing per 1M tokens: Audio input: $7.50 Image input: $0.

55 Text output: $20 Audio output: $30 Beijing pricing is lower, at $5.653, $0.466, $14.133, and $22.613 in USD.Audio input consumes 7 tokens per second.Audio output consumes 12.5 tokens per second.One hour of speech in and speech out costs about $1.54 in Singapore, before text and image tokens.

The context window is 53,248 tokens, with 49,152 for input and 4,096 for output.Default rate limits are 10 requests and 100,000 tokens per minute.Model Studio lists function calling, structured outputs, batch inference, and fine-tuning as unsupported.Key Takeaways Qwen3.

8-LiveTranslate cuts average lag (LAAL) from 2.8s to 2.3s.A new Interleave architecture improves faithfulness, fluency, and conciseness.It adds speaker diarization, bilingual display, and long-context disambiguation.It understands 60 languages and speaks 29.

Access is API-only via Alibaba Cloud Model Studio and QwenCloud.Check out the Technical Details.All credit goes to the researcher of this project.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?

now you can join us on telegram as well.Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?Connect with us The post Alibaba Qwen Team Releases Qwen3.8-LiveTranslate: A Real-Time Interpretation Model That Cuts Average Lag to 2.

3 Seconds Across 60 Languages appeared first on MarkTechPost.

Related

相關文章

MiniMax 開源 Code CLI:命令行編程工具亮出 76.7% 通過率,把企業級 harness 攤在陽光下

作為 MiniMax Code 客戶端的核心組件,它不再只是閉門打磨的產品,而是把底層實現直接交到開發者手裡。成績上它拿出了底氣。在 FrontierHarness Eval 評測裡,這個 CLI 的任務通過率達到76.7%,成功任務耗時中位數壓在4分33秒,兩項都優於公開基線——也就是說,它不只跑得對,還跑得不拖沓。

剛剛

SpaceXAI 推出 Grok Voice Transcribe 2.0:錯誤率砍半、價格紋絲不動,流式語音識別登頂榜單

它紮根於 Grok Voice 底層的音頻基礎模型,而這套底座如今已經深度嵌入真實業務:每天接住數萬通客服電話、轉錄數百萬小時的視頻旁白,還驅動著實體硬件裡的各類語音智能體,其中就包括特斯拉車機上的 Grok 助手。換句話說,它不是實驗室裡跑分的模型,而是已經在一線被海量真實語音反覆打磨過的產物。

剛剛

MiniMax 開源 Code CLI:命令行編程工具亮出 76.7% 通過率,把企業級 harness 攤在陽光下

作為 MiniMax Code 客戶端的核心組件,它不再只是閉門打磨的產品,而是把底層實現直接交到開發者手裡。成績上它拿出了底氣。在 FrontierHarness Eval 評測裡,這個 CLI 的任務通過率達到76.7%,成功任務耗時中位數壓在4分33秒,兩項都優於公開基線——也就是說,它不只跑得對,還跑得不拖沓。

4 小時前5000

SpaceXAI 推出 Grok Voice Transcribe 2.0:錯誤率砍半、價格紋絲不動,流式語音識別登頂榜單

它紮根於 Grok Voice 底層的音頻基礎模型,而這套底座如今已經深度嵌入真實業務:每天接住數萬通客服電話、轉錄數百萬小時的視頻旁白,還驅動著實體硬件裡的各類語音智能體,其中就包括特斯拉車機上的 Grok 助手。換句話說,它不是實驗室裡跑分的模型,而是已經在一線被海量真實語音反覆打磨過的產物。

5 小時前5400
量子位模型更新

27B模型分分鐘交付網頁,Qwen 3.8還是太能了

”,Qwen 3.8 27B最近在開發者圈中火了! 以前咱們做一個網頁,通常需要技術團隊花費數週心血打磨需求、畫原型、搭框架、調樣式; 而現在,Qwen3.8-27B把這整套流程壓縮成了一句Prompt後的“原地生成”。 其中,工程師Alok將Qwen3.8-27B與Cerebras疊加起來,搭了一個腦洞大開的“AI電腦桌面”。

12 小時前
IT之家模型更新

DeepSeek:調休上班的週末、中國法定節假日全天均按空閒時段計費

作者:浩渺 責編:浩渺 評論: 感謝網友 Domado、章魚小丸子 的線索投遞!9 月 19 日消息,DeepSeek 今日發佈 API 峰谷時間說明:調休上班的週末、中國法定節假日全天均按空閒時段計費。查詢獲悉,根據此前發佈的《國務院辦公廳關於 2026 年部分節假日安排的通知》,2026 年中秋、國慶具體放假日期如下:中秋節:9 月 25 日(週五)至 27 日(週日)放假,共 3 天。

14 小時前