BotPsy: On-Device Personal Assistant with a Sub-Billion-Parameter Agentic Language Model

2026年11月11日 05:01
站內 AI 整理稿

Back to Articles BotPsy: On-Device Personal Assistant with a Sub-Billion-Parameter Agentic Language Model Team Article Published November 11, 2026 Upvote 1 Milan Gritta milangritta Follow qvac Jihye Back happy-jihye Follow qvac JinUk, Cho jucho2725 Follow qvac ohjoon kwon joooon Follow qvac Patrik Lambert patrik-lambert Follow qvac Mathias Buus mafintosh Follow qvac Amril Nurman Nurman Follow qvac Frontier cloud LLMs carry high operational costs that can fluctuate unexpectedly, and relying on such third-party models introduces vulnerabilities, as providers can modify, deny, or deprecate access at any time.

Furthermore, proprietary models offer limited customization for specific workflows, while posing risks to privacy, data control, and transparency.

Besides, not every task demands frontier-level intelligence: small, specialized agents can be equally capable on specific tasks and significantly cheaper to run, since many routine or smaller workloads can be processed efficiently on-device.

As intelligence per parameter continues to improve rapidly, we aim to stand at the forefront of this shift toward performant, privacy-focused, self-hosted models.Tether AI Research introduces BotPsy, a 0.8B-parameter model introduce BotPsy, a 0.

8B-parameter model designed for function calling and agentic workflows, built on top of Qwen3.5-0.8B and suitable for on-device deployment.

BotPsy is a "personal assistant" that uses tools to perform a variety of simple tasks for the user, in domains such as web search & research, travel & lifestyle, commerce & finance, business & customer operations, device & vehicle control, files & documents, calendar, and email & messaging.

Due to its small parameter count, it is best suited to tasks of low to medium difficulty.BotPsy achieves state-of-the-art (SOTA) tool-use and agentic performance for its size, outperforming every model of up to 1.2B parameters that we tested (Figures 1 and 2).

Designed for secure on-device workflows, it provides exceptional instruction-following reliability and efficiency while keeping user data private.As a small model, BotPsy still makes mistakes and is not intended for high-stakes use; please read the Intended Use and Limitations for more information.

🤗 Model (safetensors) | 📦 GGUFs (bf16, Q8, Q4) Figure 1: BotPsy-0.8B significantly outperforms its base model and leads five of the six tool-use and agentic benchmarks, including against Qwen3.5-2B-Think (2.5× its size); only on Claw-Eval does Qwen3.5-2B-Think edge ahead.

Figure 2: Knowledge: tool-use training preserved and improved BotPsy's general knowledge compared to similarly sized models, though overall knowledge still scales primarily with parameter count.

Instruction following: BotPsy excels at following explicit instructions and multi-turn tasks, though its performance drops as instructions accumulate and lags in lower-resource languages.Copyright Complaints We will take appropriate actions in response to notice of copyright infringement.

If you believe your work has been used or copied in a manner that infringes upon your intellectual property rights, please email [email protected] identifying and describing both the copyrighted work and alleged infringing content to file a notice of infringement.

Key Highlights Benchmark results Twice the performance of its base model: BotPsy roughly doubles the agentic capability of Qwen3.5-0.8B-Think on key benchmarks: BFCL v4 rises from 23.4 to 44.0, ACEBench from 30.1 to 58.7, and τ-bench from 23.2 to 51.

5 (mean of the retail, telecom and banking subsets).Best agent in its category: BotPsy outperforms leading models in the ≤1.2B-parameter weight class (Qwen3.5-0.8B-Think, LFM2.5-1.

2B-Think, MiniCPM5-1B-Think) on all six tool-use and agentic benchmarks: BFCL v4, ACEBench, τ-bench, ToolSandbox, Claw-Eval and BrowseComp-Plus.Outperforms its larger sibling: BotPsy has the highest score of all models tested on five of the six benchmarks, beating Qwen3.5-2B-Think, a model 2.

5× its size, on BFCL v4 (44.0 vs 37.7), ACEBench (58.7 vs 55.4), τ-bench (51.5 vs 46.5), ToolSandbox (64.6 vs 41.2) and BrowseComp-Plus (4.5 vs 2.8).Only on Claw-Eval does Qwen3.5-2B-Think lead (48.9 vs 46.5).

Model capabilities More reliable in multi-turn workflows: On τ²-bench, where the agent must hold a long customer conversation, follow a strict policy, and act on the customer's behalf, it scores 82.5 in telecom, ahead of Qwen3.5-2B-Think (69.3).On BFCL v4's multi-turn tasks, it rises from 7.5 to 46.

1 over its base, nearly double Qwen3.5-2B-Think (23.8).Grouped by application, its multi-step scores lead all models tested in commerce and services (58.3 vs 47.4 for the next best, Qwen3.5-2B-Think) and in device and system management (46.1 vs 31.9).

Knows when (not) to call tools: An agent that acts must also know when not to act.On BFCL v4's hallucination tests, which check that the model declines when no appropriate tool exists, BotPsy scores 86.1, the highest of all models tested.

On ACEBench's special cases, where the request is incomplete, contains wrong parameters, or cannot be served by the given tools, it scores 51.3, up from 13.7 for its base model.Follows instructions while preserving knowledge: BotPsy specializes in tool use while preserving general skills.

Instruction following improves sharply, with IFEval rising from 59.7 to 90.8 and IFBench from 22.0 to 55.9, the highest IFBench score of all models tested.General knowledge also improves, with GPQA Diamond rising from 33.2 to 38.1 and MMLU-Pro from 41.6 to 48.9.

On all four benchmarks, BotPsy outperforms every other model of 1.2B parameters or fewer that we tested.

Safety, efficiency and deployment Safer than leading models in its category: In automated red-teaming across six harm categories, BotPsy produces unsafe responses 21% of the time, compared with 36% for its base model.This is the lowest rate of all models of up to 1.2B parameters (LFM2.5-1.

2B-Think: 35%; MiniCPM5-1B-Think: 47%).Under prompt-injection attacks, which matter most for agents that read untrusted tool outputs, the unsafe rate drops from 46% for its base model to 31%.

More efficient reasoning and less looping: On questions that all five models answer correctly, BotPsy reaches the answer with about 3× fewer reasoning tokens than its base model on GPQA Diamond (3,690 vs 11,563) and 2.7× fewer on MMLU-Pro (1,912 vs 5,105).

Across all IFBench attempts, its rate of getting stuck in repetitive reasoning loops falls from 22.9% to 1.4%, and runs that hit the 32k-token limit fall from 28.3% to 0.2%.Shorter, more decisive reasoning should reduce latency on-device.

Open-source and ready to use: BotPsy will be released with open weights under the Apache 2.0 license for research and educational use.It will be available in three precisions (bf16, Q8, Q4), as Hugging Face safetensors and as GGUF files for the QVAC SDK and llama.cpp.

Broader Vision Building upon the foundation of BotPsy, future development by Tether Data, S.A.de C.V.(“Tether AI Research”, “we”, “our”) will focus on expanding on-device agentic capabilities to seamlessly integrate with an even broader array of hardware and local services.

Tether's Hypersearch will evolve to support more robust decentralized peer-to-peer (P2P) queries, further ensuring private, encrypted web searches that bypass corporate trackers.

QVAC Fabric local fine-tuning mechanisms will be optimized to adapt more deeply to individual user preferences, workflows, and specialized tool environments.

Future iterations will allow the smartphone interface to smoothly delegate heavy computational tasks to home PCs or trusted secure P2P nodes during offline-online transitions.

Privacy protocols will be continuously strengthened to guarantee that all personal data, credentials, and decisions remain strictly on local hardware.

Collaborative features will be introduced to allow secure agent-to-agent communication across trusted local networks without compromising user confidentiality.

Ultimately, these advancements will solidify BotPsy as a fully autonomous, highly capable personal AI ecosystem that keeps users entirely in control of their digital lives.Methodology BotPsy is based on Qwen3.5-0.

8B and is post-trained in four sequential stages: Supervised Fine-Tuning (SFT), Multi-teacher On-Policy Distillation (MOPD), and two rounds of Reinforcement Learning (RL).

Each stage uses the previous stage's best checkpoint as its starting point and benefits from a different learning signal: imitation of reference trajectories, the token distributions of much larger teacher models, and rule-based tool-calling rewards (see Figure 3).Figure 3: BotPsy training recipe.

The student goes through four stages.Three specialist Qwen3.5-4B teachers, each RL-trained for one skill, guide it during the distillation stage.

Training procedure: four stages, three types of feedback Our approach uses four stages of training, which learn from three types of signal: demonstrations, specialist teachers, and verifiable rewards.

Learning from demonstrations (SFT) We first perform full-parameter supervised fine-tuning on tool-use conversations.These include multi-turn agent trajectories from simulated environments, replayed single, parallel and multi-step calls, and cases where no tool should be called.

Learning from teachers (MOPD) Next, the student is trained with on-policy distillation (OPD): it generates its own responses, and a specialist teacher provides feedback on every token, using the per-token reverse KL divergence as the training signal.

To build the teachers, we first RL-trained three Qwen3.5-4B models to specialize in tool use, general reasoning, and instruction following.During training, every prompt is routed to one of these teachers.

This stage mainly aims to recover knowledge and instruction following, which degraded during the SFT stage, although the tool-use metrics also increase (see Figure 4).Figure 4: Mean score of each capability group after each training stage.

SFT boosts tool use but pushes knowledge and instruction following below the base model; distillation brings both back above base, and the RL stages add further gains on all three.

Learning from rules and environments (RL stages) Finally, the model is trained with reinforcement learning using DAPO [1], learning only from rewards computed by rules and verifiers.The first round focuses on tool calling, accompanied by instruction following and STEM multiple-choice questions.

As in Tool-N1 [2], the tool-calling reward first checks the reasoning and tool-call format.

Instead of Tool-N1's binary correctness reward, however, it gives fine-grained partial credit in the spirit of ToolRL [3], matching the predicted tool names, argument names, and argument values against the ground truth.

The second round widens the training mix to general-domain verifiable tasks: math, code, knowledge (multiple-choice) questions, instruction following, structured outputs, and multi-step tool use in a simulated workplace environment.

Although this mix contains no multi-turn conversations, it further improves multi-turn function calling.Data composition Each stage of training uses a different data mixture (Figure 5).The SFT stage focuses mainly on tool use and prepares the ground for the subsequent stages.

The MOPD mixture combines tool-use, knowledge and instruction-following data, both to further improve function calling and to recover the general-domain regressions from the SFT stage.

The first RL stage again focuses mainly on tool use, while the second RL stage shifts the balance toward general-domain data (instruction following, knowledge, math and code), keeping a smaller share of tool use.Figure 5: Approximate training-data composition per stage, grouped by capability.

Results Tool use & agents BotPsy roughly doubles the tool-use performance of its Qwen3.5-0.8B base and is the strongest of the five models on five of the six agentic benchmarks: BFCL v4 (44.0

Related

相關文章

AI 大模型也趕雙 11:智譜、MiniMax 與阿里雲等集體開啟低折扣促銷

據最新消息顯示,包括智譜、MiniMax、千問辦公、阿里雲以及 Qoder 在內的多家頭部大模型廠商,近日集體在天貓 AI 空間站的 Token 充值中心推出了一系列力度空前的折扣活動,多款熱門產品和 Token 資源包迎來了大幅讓利。頭部廠商集體發力,多款產品迎來大幅折扣從各大廠商公佈的促銷陣容來看,此次雙11活動覆蓋了當前市場上的主流大模型服務與生態產品,具體優惠力度表現亮眼:MiniMax: 旗下多款產品集體讓利,其中三款月卡均以5折的優惠力度面向用戶開放。

21 分鐘前

Adobe MAX 放招:Photoshop 能重打光清倒影,更要把軟件交給 AI 代理操控

美國當地時間 11 月 10 日的 Adobe MAX 2026 大會上,Adobe 給 Creative Cloud 全家桶甩出一波 AI 更新,從修圖到剪輯,再到向第三方智能體敞開接口。重打光、清倒影,修圖更"狠"Photoshop 新推"重新調光"(Relight),可憑空加光源並調位置、顏色與亮度,還不動原圖;"生成式重塑"靠文字生出多版風格再拉滑塊微調。

21 分鐘前

阿里千問全新一代 Qwen4 大模型官宣:多維能力大幅進化,預覽版已正式上線

作為核心架構的迭代升級,新一代模型在知識理解的深度、世界感知的立體度以及 Coding(編程)與 Agentic(智能體)等核心能力上實現了全面進階。預覽版率先上線,多款官方應用同步接入隨著官方的正式官宣,Qwen4-Max 預覽版已率先登陸阿里 Token Plan,並推出了限時最低1折的體驗活動,個人版 Lite 及 Essential 日常起步價為39元 / 月,新客還可在此基礎上再享5折優惠,降至最低19.

2 小時前6400

AMD 亮出本地編程平臺 Instinct Coder 355:一臺機器塞進 98% 前沿模型

當地時間 11 月 9 日,AMD 攜手 Spectro Cloud 推出企業級 AI 輔助編程平臺 Instinct Coder 355,它能在本地跑起 GLM-5.3 推理,且據稱逼近前沿模型 98% 的性能。八張卡撐起一臺編程服務器這套系統的硬核在於堆料:核心是 8 張 AMD Instinct MI355X 加速器,配 2 顆 64 核的 EPYC 9575F "Zen 5" 處理器,再搭 3TB DDR5-6400 內存與合計 63.

3 小時前

OpenAI 買下 AI 旅行公司 Odessia:醉翁之意在"人"

11 月 11 日,AI 旅行智能體公司 Odessia 創始人弗朗西斯·戴維森宣佈,公司已併入 OpenAI,他自己也入職,幫這家巨頭摸索旅遊業務的方向——這樁交易被外界視為一次典型的人才收購。一歲初創,背後站著紅杉Odessia 滿打滿算才成立一年,就拿到了紅杉資本領投的 600 萬美元(約合 4012 萬元人民幣)種子前融資,約五個月前上線 AI 旅行智能體,幫早期用戶規劃出價值數百萬美元的行程。

3 小時前4600