MiniMax 發布 MiniMax-Music3:開放權重音樂模型,可從歌詞與結構化描述生成完整五分鐘歌曲

2026年8月17日 18:36
站內 AI 整理稿

MiniMax released MiniMax-Music3, an open-weights text-to-music model.The model takes two separate inputs: lyrics carrying section tags, and a detailed music description.It returns a complete song of up to five minutes in a single generation, as 32 kHz, 16-bit stereo WAV.

The architecture pairs a Hybrid-LM, an 8B Global LLM with a 0.6B Local LLM, with a continuous synthesis stack built on flow matching and a Flow-VAE.Weights, inference code and three documented serving paths shipped the same day.Is it deployable?

Yes, MiniMax published usable weights, inference code and three documented serving paths on day one, so this is deployable now rather than a research preview.Company level: Solo creators, indie studios and mid-market teams can ship on it directly.

The MiniMax-Music3 Community License permits commercial use, but it requires you to display ‘MiniMax-Music3’ prominently in the product UI, and any organization whose aggregate yearly revenue from those products exceeds US$ 20 million must obtain separate prior written authorization from MiniMax.

Anyone hosting third-party generation must also implement and maintain safeguards against infringing outputs.

Industries: Game development, advertising and brand agencies, short-form video and creator tools, e-learning, podcasting, fitness and wellness apps, retail in-store audio, and music-tech SaaS.

Applications: Background scoring for UGC video, adaptive game and level music, localized ad beds and sonic branding, scratch and demo tracks for songwriters, mood-conditioned playlist generation, and offline batch generation where per-song API cost is the constraint.

The Architecture MiniMax-Music3 combines a hierarchical autoregressive stack with a continuous synthesis path.The training tokenizer uses eight layers of residual vector quantization (RVQ).The first, semantic codebook has 16,384 entries and carries core musical semantics and structure.

The remaining seven acoustic codebooks have 1,024 entries each and encode residual detail.Training optimizes the semantic layer first, then all eight jointly.The Hybrid-LM splits the modeling problem.An 8B Global LLM predicts the first RVQ codebook frame by frame and holds long-range structure; a 0.

6B Local LLM predicts the remaining codebooks within each frame.The model card and license state the Global LLM is initialized from Qwen3-8B; the MiniMax Research post says Qwen3.5-8B, so treat the exact base checkpoint as unsettled.The synthesis stage is the more interesting design choice.

Rather than decoding from discrete RVQ tokens, MiniMax fuses the final hidden states of both LLMs and conditions a 2.4B flow-matching module on them, which maps into a latent space decoded by a 123M Flow-VAE inherited from MiniMax Speech.

At inference the discrete tokenizer decoder is not loaded at all.Two-input control Lyrics carry the words and section tags on their own lines: [Intro], [Verse], [Pre-Chorus], [Chorus], [Post-Chorus], [Bridge], [Instrumental], [Solo], [Outro].

A separate Structured Caption carries Global Metadata, Vocal Details and Arrangement.MiniMax also ships a music-caption-rewriter agent skill that expands a short description into that three-part format offline.Interactive explainer (function(){ window.addEventListener("message", function(e){ if(!e.

data || typeof e.data.mm3Height !== "number") return; var f = document.getElementById("mm3-embed-frame"); if(f) f.style.height = e.data.mm3Height + "px"; }); })(); Running it Three documented paths.

SGLang-Omni is the reference server; the GitHub page specifies two CUDA GPUs, with GPU 0 running Qwen3 and RVQ autoregressive generation and GPU 1 running flow matching and DAV decoding.

The diffusers modular pipeline fits under 24 GB VRAM at full precision, about 22 GB with automatic CPU offload, and down to 8 GB with leaf-level group offloading.ComfyUI has a native Text to Music template using repacked FP16/INT8 weights from Comfy-Org.

Key Takeaways Open-weights model generating complete five-minute songs at 32 kHz, 16-bit stereo, released August 13, 2026.Hybrid-LM design: 8B Global LLM plus 0.6B Local LLM, feeding 2.4B flow matching and a 123M Flow-VAE.

Synthesis runs on fused continuous hidden states, skipping the discrete tokenizer decoder entirely.Runs on two GPUs via SGLang-Omni, under 24 GB via diffusers, or 8 GB with group offloading.Commercial use allowed with visible attribution; above USD 20M revenue needs written authorization.

Check out the Model on HF and GitHub Repo.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?now you can join us on telegram as well.

Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?

Connect with us The post MiniMax Releases MiniMax-Music3: An Open-Weights Music Model Generating Complete Five-Minute Songs From Lyrics and a Structured Caption appeared first on MarkTechPost.

Related

相關文章

量子位生成式AI

阿里視頻大模型Wan3.0正式上線,行業評價“穩定、真實、有質感”

阿里巴巴影片生成大模型Wan3.0正式上線,單次可生成30秒影片,並首次支援doc、xls、ppt、pdf、md等文檔輸入。企業用戶普遍評價其「穩定、真實、有質感」,能穩定保持角色與場景一致性,並已進入短劇、影視、廣告等生產流程。即日起可於阿里雲百鍊、千問等平台體驗,標準版並推出限時7折優惠。

剛剛
IT之家生成式AI

阿里雲視頻生成模型 Wan3.0 正式上線,支持單次生成 30 秒視頻、文檔輸入

作者:遠洋 責編:遠洋 評論: 8 月 24 日消息,阿里雲消息,今天,視頻生成模型 Wan3.0 正式上線。官方稱,Wan3.0 在生成時長、萬能創作、全能參考以及真實世界還原等維度全面升級,單次可生成 30 秒視頻,並首次支持 doc、xls、ppt、pdf、md 等文檔格式輸入,力求準確還原真實世界。

剛剛