llama.cpp v1.0.0 : A stronger foundation for the local AI ecosystem
Back to Articles llama.cpp v1.0.0 : A stronger foundation for the local AI ecosystem Team Article Published November 13, 2026 Upvote 21 +15 Daniel Bevenius danbev Follow ggml-org Georgi Gerganov ggerganov Follow ggml-org merve merve Follow ggml-org llama.
cpp makes it possible to run multi-modal LLMs across a wide range of hardware - from consumer-grade local machines to high-end enterprise servers.Through quantization, optimized backends, and a portable C/C++ implementation, we make AI inference accessible at every level of the software stack.
We believe this is the most lightweight, versatile and sensible platform for building cross-platform and private AI products.During the 3.5 years since its inception, the project has grown a lot and many downstream applications already depend on our work.
We expect this trend to continue as local AI and privacy become increasingly important in our everyday lives.Every new integration means more developers depending on our library interfaces and therefore having a flexible but stable API is paramount.Today we release libraries v1.0.
0, highlighting our responsibility to those developers.Moving forward, both llama.cpp and ggml will reflect API and ABI incompatibilities with major-version bumps.As adoption grows, we will be stricter about making those boundaries visible to downstream consumers.
Releases Release Library Public header(s) llama.cpp v1.0.0 - LLM inference in C/C++ libllama llama.cpp/include/ ggml v1.0.
0 - Tensor library for machine learning libggml ggml/include/ Semantic version update rules The following rules apply to all ggml-org projects using semantic versioning: Change type Bump MAJOR Breaking change to the public C API in .
/include MINOR Backward-compatible feature, backend updates, model support, or API addition PATCH Bug fix with no API change Distribution We are looking forward to expanding the ways in which ggml-org software is distributed and reaches developers and end-users.
For more information about how to add ggml-org projects to your packaging and release pipelines, please check the following discussion.
Channel Platforms Pre-release artifacts Linux, macOS, Windows, Android, iOS Docker Linux Debian Linux Homebrew macOS, Linux conda-forge Windows, macOS, Linux MacPorts macOS Winget Windows XCFramework iOS, macOS Development The project has fostered an amazing open-source community with highly-skilled and talented contributors.
With the rapid advance of AI capabilities in the field of software engineering, we continue to adapt and integrate LLMs in our developement cycle in a thoughtful and resonable manner.
Maintaining a high quality codebase, staying in control of the architecture and understanding the implementation details will remain our top priorities.To reinforce the faster pace of development we continue to invest more and more resources in improving the CI infrastructure behind the projects.
Thanks to HF technologies such as HF Buckets and HF Jobs we are able to scale the capacity necessary to guarantee correctness for every change that lands on the master branches.
With hardware support from NVIDIA, AMD, Qualcomm, Arm, IBM and Intel, we continue to enroll more self-hosted runners across all major hardware platforms.Backend and model coverage The underlying machine learning engine of llama.cpp - ggml is designed to run on virtually any hardware in existence.
This is achieved by implementing dedicated ggml backends.Each backend can be compiled as a dynamic library and optionally loaded at runtime.A complete list of the currently implemented backends can be found here.We are committed to provide continuous support of all model architectures.
Currently, llama.cpp supports more than 150 architecture variants as well as all mainstream speculative decoding methods.Thanks The llama.cpp team at Hugging Face is thankful for the incredible support from the community.
Special thanks to the long-time maintainers of the project and all contributors.This is a significant milestone which would not have been possible without our joint efforts!Additional resources llama.
cpp examples ggml-org at Hugging Face ggml-org at Github Check out Llama desktop apps for MacOS and Windows, shipped with love by the team behind llama.cpp and Hugging Face.More from this author New in llama.cpp: Decision Models 110 October 2, 2026 Using OCR models with llama.
cpp 45 April 10, 2026 Community clem 26 minutes ago 🔥🔥🔥 Reply pcuenq 25 minutes ago Let's go!!Reply andito 8 minutes ago THIS Reply cpoisson 5 minutes ago 🚀 Reply burtenshaw less than a minute ago YES!
Reply EditPreview Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.Tap or paste here to upload images Comment · Sign up or log in to comment Upvote 21 +9
Related
相關文章
88比12!在攻克癌症這件事上,垂類AI比國際主流通用大模型和人類醫生都在行?
作者 | 王涵 編輯 | 漠影 攻克癌症一直是全球醫學界最重大的命題之一,現在這一目標也被AI盯上了。 近期,生物醫藥公司Generate Biomedicines藉助Claude Code重新設計CAR-T療法中的細胞內信號結構域,嘗試在縮短組件長度的同時提升免疫細胞活性。實驗中,一項AI參與生成的設計將信號結構域縮短約70%,使細胞表面受體數量增加約10倍,並展現出更強的腫瘤細胞殺傷能力。 隨著通用大模型的不斷發展,其正逐漸從整理醫學知識、輔助科研,走向疾病研究和臨床診療。
語飛國際中文教育垂直大模型發佈:深度融合專業教學場景,為全球師生與機構提供智能化服務
據央視新聞報道,2026世界中文大會於11月13日在北京正式開幕。在本次大會上,官方重磅發佈了語飛國際中文教育垂直大模型,旨在為全球範圍內的中文學習者、一線教師以及各類教育機構提供全方位的智能化服務。
Google Releases Gemini 4 Hydrogen: 2.5x Faster Than Gemini 3.8 Flash
Google has released Gemini 4 Hydrogen, a fast model for coding and agentic work. Gemini 4 Hydrogen is a proprietary model from Google DeepMind built for everyday agent loops. It sits below the frontier models Gemini 4 Carbon and Gemini 4 Argon.
近20項全球首發!TCL華星亮出AI顯示全家桶,對話印刷OLED中心總經理曹蔚然
作者 | 雲鵬 編輯 | 心緣 11月13日武漢現場報道,在今年的全球顯示生態大會(DTC 2026)上,TCL華星一口氣端出了近40項產品和創新技術,AI成為全場多位高管強調的重點。圍繞AI,TCL華星在畫質、護眼、低功耗、車載、印刷OLED,以及上下游生態合作方面做了不少技術、業務佈局。 值得一提的是,在本次展出展品中,有近20項“全球首發/之最”,刷新各項行業紀錄,從AI研發智能體、各類顯示面板創新到半導體先進封裝技術。 TCL華星的星智大模型迭代至4.
9.99萬的ID.ERA 5X,大眾開始用中國效率打價格戰
從過去全球技術導入中國,轉向中國本土研發定義產品,並反哺全球,大眾在華的研發模式迎來的關鍵轉身,集中在一款新車型中。11月12日,上汽大眾ID.ERA 5X正式上市,限時權益價9.99萬起,共推出四款配置。定位都市純電SUV,瞄準年輕用戶與家庭市場。
騰訊混元甩出實時語音模型 Hy Realtime,會聊天、能唱歌、還會自己聯網搜
作為一款主打實時的語音模型,它在語音理解、指令遵循與擬人化表達等基礎對話能力上表現優異,更一口氣補齊兩項新本領:一是 Agentic 工具調用,二是唱歌。換言之,它不再是單純應答的"嘴",而開始長了能幹活的手,離"像人一樣交流"又近了一步。