Apertus 1.5 Release Notes
Back to Articles Apertus 1.5 Release Notes Team Article Published October 15, 2026 Upvote 8 +2 Hanna Yukhymenko hannayukhymenko Follow swiss-ai Oleg Lavrovsky loleg Follow swiss-ai Y Metz ymetz Follow swiss-ai Our latest release, Apertus 1.5, extends the 8B and 70B Apertus 1.
0 models with image/audio understanding, an optional thinking mode, a four times longer context window, improved instruction-following, and better tool use.The updated 8B and 70B model weights were released to Hugging Face on July 24, 2026 under an Apache 2.0 license.
Further details are now available from the project Technical Report, and summarized here.Apertus 1.
5 is a continued pretraining of the first generation model: adding 4 trillion tokens of text and multimodal training data to the 8B model and 2 trillion tokens to the 70B model, for a total of 19T and 17T, respectively.
As with every Apertus release, the models are fully open: open weights, open data, open values, and full training details.Key Enhancements Native Multimodal Understanding: Apertus 1.5 accepts images and audio alongside text, bringing documents, diagrams, and photos into the conversation.
The models can also process spoken language, though this remains experimental.Thinking Mode: The models can be switched into a thinking mode to reason about the input before answering, which improves performance on reasoning problems.
Long Context: The context window grows to 262,144 tokens, a 4x increase over Apertus 1.0.Improved Instruction-Following: Better instruction adherence than Apertus 1.0 gives more predictable and accurate responses.
Improved Tool Use: The models are trained for better tool integration, allowing more effective use of external tools and APIs.Open Values: Stronger adherence to the Apertus Charter, which brings transparency to the model’s values and principles.Training Process The full Apertus 1.
5 training pipeline Multimodality Through the Tokenizer We introduce multimodality in v1.5 models in an early-fusion manner, where images and audio enter Apertus as discrete tokens in the same sequence with text tokens, instead of using a separate vision encoder.Images are tokenized with the Emu3.
5 tokenizer (a 512×512 image becomes 1,024 tokens) and audio with WavTokenizer (40 tokens per second).We only extend the vocabulary, so the architecture stays unchanged and training runs at text-only speed.The models understand images and audio but generate only text.
Pre-Training Starting from Apertus 1.0, we continue pretraining in four stages: Unpaired: text plus standalone images and audio, so the model learns the new modalities.Paired: image–caption and audio–transcript pairs, so it aligns them with language.
Cooldown: higher-quality data with more math and code.Long context: the window grows step by step from 8k to 262k tokens.Overall, more than half of the training tokens are text-only, which preserves the language abilities of Apertus 1.0.
The text data is refreshed with sources such as FineWeb2-HQ+, FinePDFs, and Nemotron-CC.All new data, multimodal included, meets the same bar as before: publicly available, permissively licensed, and with robots.txt opt-outs respected retroactively.
Every source is listed in apertus-data-transparency.Post-Training Post-training runs in five stages: SFT → long-context SFT → RL → DPO → charter alignment (SDPO).SFT on 3.7M text samples plus image and speech data.Reasoning traces are added only to prompts the model can't already solve without them.
Tool-use data is restricted to execution-verified trajectories.We release the text SFT mix we used on Hugging Face.Long-context SFT at the full 262k window restores the long-context ability that short-context SFT erodes.
RL with verifiable rewards (RLVR) on about 350k math, code, instruction-following, multilingual, and vision prompts, mixing thinking on and off.DPO with judge-scored preference pairs improves chat quality, tool use, and safety.We release the preference pool and training pairs.
SDPO aligns the model with the Apertus Charter through judge feedback and self-distillation.Evaluation Results Alongside the extended model capabilities, we also significantly expanded the scope of evaluations.Beyond the existing text-based evaluations used for Apertus 1.
0, we added multimodal evaluations (image & audio), and thinking-mode evaluations.The multimodal evaluations are done through MLLM-eval-suite pipeline, merging two major multimodal evaluation frameworks lmms-eval and VLMEvalKit.
We also added a series of text-based benchmarks, as well as extended benchmarking for translation and multilingual capabilities, safety, and tool use.These can be found in our post-training evaluation repository, based on lm-evaluation-harness fork.
While still trailing frontier open-weight models, the new release has also significantly improved performance in coding and instruction following capabilities with Apertus 1.5 8B outperforming similarly sized open-weight models on IF and multilingual tasks.
Thinking further improves performance on challenging reasoning-heavy benchmarks like AIME.The multimodal performance of the model is closer to Gemma 4 12B and other current open-weight models.Apertus 1.
5 multimodal performance is competitive in spatial understanding among open-weight models and document/chart understanding among open-source models.We also thank our collaborators and external evaluators for their help with efficient benchmarking of Apertus capabilities.In particular, Apertus 1.
5 shows strong performance on Swiss Legal tasks, being on par with leading open-weight models (blog, code).Additionally, on Last Translation Benchmark, Apertus 1.5 8B presents machine translation capabilities which match GPT-OSS-20B and outperform models like Claude Haiku 4.
5 or Google Translate (leaderboard, paper).Evaluation Cards: Apertus ❤️ EvalEval Apertus collaborates with the EvalEval Coalition to ensure fully transparent and reproducible benchmarking.We publish the Apertus 1.
5 results in the Every Eval Ever (EEE) schema, a shared format that records not only scores, but also who ran the evaluation, how the model was accessed, the generation settings, and how each metric should be interpreted: details that are routinely missing from leaderboards and that often explain why similar-looking scores differ.
The results are shown in the Eval Card below, which combines the run data with benchmark and model metadata into one interpretable record, and are also available through Hugging Face Community Evals.This is the same infrastructure the UK AI Security Institute uses to publish its evaluations openly.
Since our text evaluations run on our public fork of lm-evaluation-harness, which EEE supports with a dedicated converter, anyone can rerun them and compare their numbers against ours under identical settings.Structured evaluation reporting also matters beyond research.
EvalEval has mapped Evaluation Cards to AI governance requirements, including Article 55 of the EU AI Act and the GPAI Code of Practice, and found that the EEE schema can represent 56 of the 60 evaluation-reporting elements these frameworks call for.
This fits how we already release Apertus: alongside the models, we publish a Public Summary of Training Content and, voluntarily, a Code of Practice document.
Machine-readable evaluation records are a natural next step: making it easier for regulators, deployers, and researchers to find, interpret, and compare the evidence behind a model.
We are committed to promoting reproducible and transparent evaluation through Eval Cards and the EEE schema, and encourage other model developers to report their results in the same way, so that scores can be compared across models and organizations.Apertus 1.
5 Reproducibility All recipes, ablations, and data mixtures are documented in the Technical Report.We aim to popularize open model development by making the v1.5 training process public and accessible.Intermediate checkpoints are hosted in our Apertus 1.
5 Hugging Face collection, including the base weights, SFT, RLVR and DPO, as well as our curated training data mixes/custom datasets in Apertus 1.5 datasets collection.Sharing them allows researchers to investigate how each stage changes the model behavior.
The report covers numerous ablations on the effect of post-training data in different stages, where we observed that the multimodal data mixed in together with text data during SFT helps improve across all modalities.
We also find that the benefits of multimodal reasoning traces survive the subsequent text-only reinforcement learning: starting from an SFT checkpoint trained with multimodal traces, RL improves mathematics more than when starting from a text-only checkpoint, and the advantage on reasoning tasks persists throughout training.
Models 8B 70B Pre-training (long-context base) Apertus-v1.5-8B-base Apertus-v1.5-70B-base Supervised finetuning (SFT) Apertus-v1.5-8B-SFT Apertus-v1.5-70B-SFT Reinforcement learning (RLVR) Apertus-v1.5-8B-RLVR Apertus-v1.5-70B-RLVR Preference alignment (DPO) Apertus-v1.5-8B-DPO Apertus-v1.
5-70B (final) Charter alignment (SDPO) Apertus-v1.
5-8B (final) – Stage Data Code / recipe Pre-training: Stages 1–2 (unpaired, paired) All sources with versions and licenses in apertus-data-transparency; vision and audio processing recipes in multimodal-data Megatron-LM, launch scripts in pretrain-code, apertus-omni-tokenizer, benchmark-image-tokenizer, benchmark-audio-tokenizer (incl.
interleaved speech–text builder) Pre-training: Stage 3 (cooldown) apertus-data-transparency; curated image datasets NASA, Our World in Data, Smithsonian, swisstopo Megatron-LM, launch scripts in pretrain-code Long-context extension apertus-data-transparency; synthetic long-context tasks in LongContextQA Megatron-LM, launch scripts in pretrain-code SFT Apertus-v1.
5-SFT-mix (multimodal SFT mix listed in the report) posttraining-data, Megatron-LM (SFT launch scripts) Long-context SFT Subsets of the SFT mix (listed in the report), plus LongContextQA tasks Megatron-LM RL (RLVR) Mixture listed in the report verl, verl-recipe DPO Apertus-v1.
5-Preference-Pool (annotated completions), Apertus-v1.
5-Preference-Data (pairs) posttraining, verl SDPO (charter alignment, 8B only) gretelai/gretel-safety-alignment-en-v1 self-distillation Model Availability Proton Lumo and Infomaniak Euria are two widely used apps that have recently integrated Apertus 1.5.
These deployments are linked in the Community Showcase among others - see this discussion thread for a preview.Access to Apertus 1.
5 in the form of an API for developers has been announced by a range of providers, including Swisscom, Infomaniak, Phoeniqs, and other companies listed in our General Availability guide.The report also provides details on how we work with external evaluators to test and prepare the models.
Technical instructions for running the models are in the model cards of the Apertus releases on Hugging Face and in our Quickstart guide.How to Get Involved Thank you for reading this blog post and being part of our community!
We just celebrated five million downloads in our Hugging Face analytics 🤗 and are not slowing down.At the recent AI+X Summit in Zurich, our team announced the roadmap for Apertus 2.
0: sparse/MoE architecture, ~600B total parameters, extended training schedule, with agents, mathematics and coding as priorities.In summary: we invite you to read our report, download the models, explore the intermediate checkpoints, finetune the weights, and reproduce our evaluations.
Questions that are not already covered in our publications or website FAQ are always welcome, and we would also love to hear which topics would be most useful to the community for future deep dives.
If you build with or use Apertus, please fill out the Showcase form, and reach out through the options on our Contact page.We are looking forward to highlighting more work, learning what you are building, and he
Related
相關文章
如何使用 Meta 的 Rebalancer 進行任務部署與最佳化
在本教學中,我們實作 Meta 的任務分配求解器 Rebalancer,採用 C++ 核心並搭配 Python 繫結。我們說明物件、容器、維度、範圍與分割區,加入限制條件與目標,然後選擇區域搜尋或精確混合整數求解器 HiGHS。我們建立一個小型資料中心,排空忙碌的主機,並在玩具模型、互斥主機、合成叢集及 60 個公開的 OR-Library 實例上比較兩種求解器。
惡意微調防線被持續訓練擊穿
Computer Science > Cryptography and Security arXiv:2605.14605 (cs) [Submitted on 14 May 2026 (v1), last revised 7 Oct 2026 (this version, v3)] Title:A Few Steps Further: Why Defenses Against Malicious Finetuning Erode Un。
Google Research Moves Federated Learning Into TEEs: Gboard Now Trains With Externally Verifiable Differential Privacy
Google Research has announced a next-generation Federated Learning (FL) system built on Trusted Execution Environments (TEEs).
《Dream it Possible》旋律再起,全新華為Mate 90系列踏光而來!
在10月1日的華為Mate 90系列及全場景新品發佈會上,開場曲《Dream it Possible》全新版本旋律響起,瞬間把全場的記憶拉回那些與歷代Mate同行的歲月。而華為Mate 90系列核心精神內核“踏光向前”,就藏在這首歌與Mate共同寫下的故事裡。回頭看,這首歌的每次唱響都踩在Mate的關鍵節點上,與品牌理念同頻共振。

特朗普簽署行政令把 AI 改叫 SI,推出美國政府對話式問答網站
作者:汪淼 責編:汪淼 評論: 感謝網友 火瓶座、有鯽雪狐、不一樣的體驗、軟媒新友2547452、呼呼啦啦啦噠 的線索投遞!9 月 30 日消息,美東時間週二(9 月 29 日),美國總統特朗普正式簽署行政令,下令所有行政部門和機構使用“超級智能”(Super Intelligence,簡稱 SI)一詞代替人工智能(AI)。
Perplexity Introduces Photon: A Rust-Based Retrieval Engine That Cuts p99 Latency From 800 ms to 65 ms
Perplexity has released Photon, an in-house retrieval and ranking engine written in Rust. It replaces an open-source engine Perplexity had forked for its AI-native search stack. Photon now handles retrieval and ranking for all production traffic.