Hugging Face BlogAI Agent

安全事件披露 — 2026年7月

2026年7月16日 00:00

重點摘要

返回文章列表 安全事件披露 — 2026年7月 發表於 2026年7月16日 GitHub 更新 點贊 13 +7 系統 系統 關注 本週稍早,我們偵測到並應對了一起針對部分生產基礎設施的入侵事件。這起事件與我們以往處理的任何情況有一個重要不同:它全程由自主AI代理系統驅動——而我們也主要依靠自身的AI系統偵測並剖析了它。我們發現未經授權的存取行為涉及一組有限的內部資料集,以及多項服務所使用的憑證。我們仍在評估是否有合作夥伴或客戶資料受到影響,如有將直接聯繫相關方。目前沒有發現任何公開、面向用戶的模型、資料集遭到竄改的證據。

站內 AI 整理稿

Back to Articles Security incident disclosure — July 2026 Published July 16, 2026 Update on GitHub Upvote 13 +7 system system Follow Earlier this week, we detected and responded to an intrusion into part of our production infrastructure.

This one was different from anything we had handled before in one important way: it was driven, end to end, by an autonomous AI agent system - and we detected and dissected it largely with AI of our own.

We identified unauthorized access to a limited set of internal datasets and to several credentials used by our services.We are still completing our assessment of whether any partner or customer data was affected, and we will contact any affected parties directly as required.

We have found no evidence of tampering with public, user-facing models, datasets, or Spaces, and our software supply chain (container images and published packages) was verified clean.What happened The intrusion started where AI platforms are uniquely exposed: the data-processing pipeline.

A malicious dataset abused two code-execution paths in our dataset processing (a remote-code dataset loader and a template-injection in a dataset configuration) to run code on a processing worker.

From there, the actor escalated to node-level access, harvested cloud and cluster credentials, and moved laterally into several internal clusters over a weekend.

The campaign was run by an autonomous agent framework (appearing to be built on an agentic security-research harness - used LLM still not known) executing many thousands of individual actions across a swarm of short-lived sandboxes, with self-migrating command-and-control staged on public services.

This matches the "agentic attacker" scenario the industry has been forecasting.What we did Fixed the root vulnerability: the dataset code-execution paths used for initial access are closed.Eradicated the attacker's foothold across the affected clusters and rebuilt the compromised nodes.

Revoked and rotated the affected credentials and tokens, and began a broader precautionary rotation of secrets.Deployed additional guardrails and stricter admission controls on our clusters.

Improved our detection and alerting so a high-severity signal pages a responder in minutes, any day of the week.We are working with outside cybersecurity forensic specialists to investigate the issue and review our security policies and procedures.

Finally, we have also reported this incident to law enforcement agencies.For our community As a precaution, we recommend rotating any access tokens and reviewing recent activity on your account.If you believe you are affected, or want to report a security concern, contact us at security@huggingface.

co.We are grateful to the teams across Hugging Face who responded around the clock, and we are sorry for any disruption this caused.Security is never finished; we will keep raising the bar.Analyzing an AI-driven intrusion The attack was initially surfaced through AI-assisted detection.

Our anomaly-detection pipeline uses LLM-based triage over security telemetry to separate real signals from the daily noise, and it was the correlation of those signals that flagged the compromise.

To understand what a swarm of tens of thousands of automated actions did, we ran LLM-driven analysis agents over the full attacker action log, comprised of more than 17,000 recorded events.

This allowed us to reconstruct the timeline, extract indicators of compromise, map the credentials touched, and separate genuine impact from decoy activity.Thanks to this approach, we were able to do in hours what would usually take days, and match the adversary's speed.

The choice of models we could use for this analysis was constrained in a way we did not anticipate; we describe this below.The asymmetry problem When we started the log analysis, we first used frontier models behind commercial APIs.

This did not work: the analysis requires submitting large volumes of real attack commands, exploit payloads, and C2 artifacts, and these requests were blocked by the providers' safety guardrails, which cannot distinguish an incident responder from an attacker.

We ran the forensic analysis instead on GLM 5.2, an open-weight model, on our own infrastructure.This had a second benefit: no attacker data, and none of the credentials it referenced, left our environment.This experience points to a gap worth planning for.

We do not know which model powered the attacker's agents, whether a jailbroken hosted model or an unrestricted open-weight one; either way, the attacker was bound by no usage policy, while our own forensic work was blocked by the guardrails of the hosted models we first tried.

The practical lesson for defenders: have a capable model you can run on your own infrastructure vetted and ready before an incident, both to avoid guardrail lockout and to keep attacker data and credentials from leaving your environment.

This is not an argument against safety measures on hosted models, and we are sharing this feedback with the providers concerned.What this means Autonomous, AI-driven offensive tooling is no longer theoretical.

It lowers the cost of running a broad, patient, multi-stage campaign, and it operates at machine speed.Defending an online platform now means treating the data and model surface as a first-class attack surface, and using AI on defense to keep pace.

We will keep investing there, and keep sharing what we learn.Community EditPreview Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.Tap or paste here to upload images Comment · Sign up or log in to comment Upvote 13 +1

Related

相關文章

當 human in the loop 變成“閉著眼睛點確認”,企業Agent 安全還能靠誰?

專家指出,AI Agent 從內容安全轉向行為安全,提示詞注入、工具濫用與過度授權成為主要風險。企業應建立可視、可管、可追溯的安全基線,並對工具權限進行最小化與臨時化管理,避免 human in the loop 淪為形式。安全防護需從靜態入口轉向動態行為約束,以因應 Agent 自主執行帶來的全新挑戰。

剛剛

開源Agent框架刷爆ARC-AGI-3,「自我改進」的RLM harness引爭議

一套開源Agent框架在ARC-AGI-3基準測試中創下超過85%的正確率,大幅領先其他解決方案,其核心是名為「RLM harness」的自我改進機制。然而,該方法引發學術爭議,部分研究者批評它透過反覆試錯「鑽漏洞」,不符合ARC-AGI評測一次性推理的精神。這場討論促使AI社群重新審視評測標準,並可能影響未來ARC-AGI版本的設計方向。

剛剛
TechWebAI Agent

ChinaJoy 2026 AI遊戲規模化落地,邊緣雲與API安全重構產業底層邏輯

2026年ChinaJoy展館,“與AI同遊”的主題隨處可見。行業調查顯示,僅有21%的企業擁有完整的API資產清單,大量後臺AI接口仍在無人監控的狀態下裸奔。合規與安全也同步下沉。算力下沉還不夠,API安全必須同步前移邊緣雲解決了體驗問題,但AI交互入口的安全,同樣需要前置到邊緣。算力與安全,缺一不可Akamai的判斷很明確:遊戲AI轉型不能割裂算力與安全。這也是遊戲廠商規模化落地AI智能體、構建AI原生遊戲的標準化底層方案。

4 小時前
量子位AI Agent

螞蟻集團開源Avernet,讓人與智能體像組織一樣高效協作

**螞蟻集團開源Avernet:打造人與智能體高效協作的“組織級”基礎設施** **來源:量子位** **2026-08-07 11:08:51** 近日,螞蟻集團正式宣佈開源多智能體協作基礎設施Avernet,其社區版本已同步上線。作為業界首個聚焦於“組織級協作”的智能體基礎設施,Avernet的首個版本重點開放了智能體協作網絡能力,旨在支持不同智能體之間的發現、共識達成、跨團隊協作與治理,為人工智能從“單點智能”走向“系統智能”提供關鍵支撐。

9 小時前