面壁智能聯合清華等開源中國首個基於華為昇騰訓練的 1.58-bit 端側大模型 BitCPM-CANN

重點摘要
面壁智能聯合清華大學等團隊,開源中國首個基於華為昇騰訓練的 1.58-bit 端側大模型 BitCPM-CANN,提供 0.5B 至 8B 四種參數規模。該模型利用極低精度量化技術減少運算與記憶體需求
**重點整理**
面壁智能聯合清華大學等團隊,正式開源中國首個基於華為昇騰訓練的 1.58-bit 端側大模型 BitCPM-CANN。該模型從量化算子、訓練演算法到全鏈路框架,皆在華為昇騰平台原生完成,並提供 0.5B、1B、3B、8B 四種參數規模。
**背景脈絡**
1.58-bit 是極低精度的量化技術,能大幅減少模型運算與記憶體需求,適合部署在手機、物聯網設備等邊緣端。過往中國端側大模型多依賴 NVIDIA GPU 訓練,此次基於華為昇騰原生開發,展現國產 AI 晶片在訓練鏈路上的突破。
**可能影響**
此舉有助於降低對國外 GPU 的依賴,加速國產 AI 軟硬體生態的閉環。對開發者而言,低精度模型讓終端裝置能更有效率地運行大型語言模型,可能帶動更多端側智慧應用落地,例如離線語音助手或輕量級對話機器人。
**讀者可關注的後續**
後續值得觀察的包括:BitCPM-CANN 在實際端側設備上的推論速度與準確率表現、開源社群的反饋與貢獻,以及面壁智能是否會推出更小或更大參數的版本。此外,華為昇騰生態在模型訓練工具鏈上的成熟度,也將影響未來更多團隊投入類似開發。
Related
相關文章
Liquid AI Introduces LFM2.5-Embedding-350M and LFM2.5-ColBERT-350M: Dense Bi-Encoder and Late-Interaction Models for Fast Multilingual Search Across 11 Languages
This week, Liquid AI released two new retrieval models. They are LFM2.5-ColBERT-350M and LFM2.5-Embedding-350M. Both hold 350M parameters. Both are the first bidirectional members of the LFM family. They build on LFM2.5-350M-Base, released in March. The pair targets fast multilingual and cross-lingual search across 11 languages. Their footprint is small enough to run almost anywhere. Both are available now on Hugging Face under the LFM Open License v1.0. LFM2.5 Retrievers The two models share one backbone but represent text differently. LFM2.5-Embedding-350M is a dense bi-encoder. It turns each document into a single vector. Pick it when you want the fastest search and the smallest, cheapest index. LFM2.5-ColBERT-350M is a late-interaction model. It converts each token into a vector rather
Perplexity Launches Brain, a Self-Improving Memory System That Builds a Context Graph of an Agent’s Work and Learns Overnight
Most AI memory remembers the user. It stores your preferences, your tastes, and your role. Perplexity is taking a different path. Today, Perplexity launched Brain, a self-improving memory system for its agent product, Computer. Brain does not focus on remembering you. It remembers what the agent did. That reframes what memory in AI is for. What is Perplexity‘s Brain Brain is a self-improving memory system. It builds a context graph of the work Computer performs. At set intervals, such as overnight, Brain reviews that graph. It then teaches itself how to do the work better. The idea is straightforward. The more work you do, the more efficient Brain makes your Computer. Brain is rolling out today to Perplexity Max and Enterprise Max subscribers in Research Preview. Two Axes of AI Memory Perp

智譜新高,MiniMax承壓,“大模型雙雄”命運殊途
這篇消息聚焦「智譜新高,MiniMax承壓,“大模型雙雄”命運殊途」。原始導語提到:大模型在被市場重新定價 從 AI 情報角度來看,這類內容值得關注其背後的技術進展、產品落地、產業競爭與後續市場影響。

華為昇騰 0 Day 支持智譜 GLM-5.2 模型,提供全面推理優化
華為昇騰 AI 宣佈在智譜開源 GLM-5.2 大模型當天即完成深度推理優化。通過 MOE 大融合算子、通信計算融合、高併發調度等七項關鍵技術,顯著提升編程和長程任務的處理效率,現已支持 A3 系列產品部署。#AI 大模型# #國產算力#
企業AI轉型再添利器:青雲科技算力雲接入 MiniMax-M3 模型
企業AI落地面臨高效低成本難題。青雲科技旗下基石智算平臺接入國產開源大模型MiniMax-M3,提供新算力支持。MiniMax-M3以卓越上下文處理能力等三大核心技術見長,依託自研架構,助企業便捷部署AI業務。
阿里開源統一科學大模型 LOGOS,僅用五十六分之一參數超越微軟
阿里 ATH-Token Foundry 聯閤中國人民大學高瓴人工智能學院開源科學基礎模型 LOGOS。該模型採用統一科學語法與純序列建模範式,在六大科學任務上匹配或超越傳統專用方法。其中 LOGOS-1B 僅 1B 參數,即展現出極高效率,性能超越參數量達 8×7B 的微軟模型。