Google Research 推出 GlucoFM:用於連續血糖監測的 0.72M 參數雙流基礎模型

2026年8月27日 04:13
站內 AI 整理稿

Google Research and UNSW Sydney have released GlucoFM, a self-supervised foundation model for continuous glucose monitoring.Its core move is a split.Existing CGM models — CGMformer, GluFormer, CGM-JEPA — encode a glucose trace as one entangled sequence.

GlucoFM decomposes it into a slow physiological “state” stream and a transient “event” stream, keeps the observation mask intact, and pretrains with two JEPA-style latent objectives.The result is a 0.72M-parameter encoder that reached 58.

8 task-averaged PR-AUC across 14 cohort–task evaluations, against 54.7 for the strongest CGM-specific baseline retrained on the same corpus.It was pretrained on 109,066 hours of unlabeled CGM from 477 subjects, on a single H100.Is it deployable?As research infrastructure, yes.

As a clinical or consumer product, not yet.The research team state it directly: GlucoFM is a research prototype, has not been cleared or approved by any regulatory authority, and is not intended to diagnose, treat, cure or prevent disease.

Every evaluation is retrospective, the largest pretraining cohort is non-public, and no checkpoint has shipped as of 26 August 2026 — the paper commits to releasing code and reproducibility scripts.What is deployable today is the recipe.At 0.

72M trainable parameters and 120 epochs on a single NVIDIA H100, any team with a CGM corpus can reproduce it, and 24-hour-window inference runs on a CPU container or on-device.

The problem with treating CGM as one signal Existing CGM foundation models like CGMformer, GluFormer and CGM-JEPA encode a glucose trace as a single entangled sequence.

But CGM carries two things at once: a slow regulatory baseline, and short transient deviations from meals, activity, stress or sensor artifacts.Clinical labels are also expensive and cohort-specific, which caps supervised training.(function(){ var f = document.

getElementById('mtp-glucofm-frame'); window.addEventListener('message', function(e){ if(e && e.data && e.data.gfmHeight && f){ f.style.height = e.data.gfmHeight + 'px'; } }, false); })(); #mtp-glucofm-wrap hr,#mtp-glucofm-wrap p:empty,#mtp-glucofm-wrap del,#mtp-glucofm-wrap s{display:none !

important;} Architecture GlucoFM aligns each recording to a fixed 24-hour grid at Δt = 5 minutes, giving L = 288 positions, and preserves the absolute circadian start index.

An observation mask M is retained end to end — missing positions are filled only to build a tensor and never counted as measurements.An ablation shows dense interpolation underperforms this mask-aware default.

A causal, mask-aware learnable Gaussian filter then splits the signal: the filtered trend becomes the state stream, the masked residual the event stream.Bandwidth σ is learnable within 2–12 grid steps, roughly 10–60 minutes, initialized at 6.0.

A one-sided kernel enforces causality, so future glucose never leaks into the current state estimate.Both streams are tokenized into 24 one-hour patches, fused into 128-dimensional tokens, and given circular time-of-day features.

Pretraining uses two JEPA-style objectives: masked contextual latent prediction over 50–60% of patches against an EMA teacher (m = 0.997), and next-patch state/event dynamics prediction via residual transition heads.

CGM-aware augmentations add baseline wander, compression-like drops, decimation to 15-minute sampling, and disconnection blocks.The encoder is a 3-layer Transformer, hidden dimension 128, 4 heads, feed-forward 256 — 0.72M trainable and 1.18M total parameters.

Pretraining used 109,066 hours of unlabeled CGM from 477 subjects across Wear-CGM, ShanghaiT2DM, Stanford, BIG IDEAs and Colas.<!

– INTERACTIVE EXPLAINER EMBED GOES HERE –> Results Under subject-disjoint linear probing across four cohorts and seven tasks (14 cohort–task evaluations), GlucoFM reached 58.8 task-averaged PR-AUC against 54.7 for the strongest CGM-specific baseline retrained on the same corpus — +4.

1 points, about 7.5% relative — and 5.8 above the best GluFormer variant.It led PR-AUC on every diabetes-risk and beta-cell-dysfunction evaluation and 3 of 4 insulin-resistance evaluations, and ranked first on 21 of 24 cross-dataset transfer evaluations.

For two-hour postprandial glycemic response forecasting it reached 21.88 mg/dL MAE with full context, against 22.90 for the best baseline and 27.69 for a train-fold mean, over 874 meal events from 34 participants across Dexcom and Libre sensors.

It also beat a seven-day GMI threshold rule on macro-F1 by +7.4 points on Stanford and +17.4 on CGMacros-Dexcom.Trained on 20% of the corpus, it already matched CGM baselines trained on all of it.

Key Takeaways GlucoFM splits CGM into a slow “state” stream and a transient “event” stream instead of one entangled sequence.0.72M trainable parameters beat a 135M GluFormer and a 385M MOMENT on task-averaged PR-AUC.58.8 vs 54.

7 PR-AUC over the best same-corpus CGM baseline across 14 cohort–task evaluations.Strongest gains are on diabetes risk, beta-cell dysfunction and insulin resistance — the clinically central tasks.It is a research prototype with no regulatory clearance and no public checkpoint yet.

Check out the Paper and Technical Details.Also, feel free to follow us on Twitter and don’t forget to join our 150k+ML SubReddit and Subscribe to our Newsletter.Wait!are you on telegram?now you can join us on telegram as well.

Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?Connect with us The post Google Research Introduces GlucoFM: A 0.72M-Parameter Dual-Stream Foundation Model for Continuous Glucose Monitoring appeared first on MarkTechPost.

Related

相關文章

MarkTechPost AI模型更新

Google 開源 Harness²:遞迴代理程式框架,無需新模型也能提升效能

Google Cloud AI Research 開源了 Harness²,這是一個遞迴代理程式框架,透過改良凍結模型周圍的程式碼與檔案來增強效能。對開發者而言,重點很簡單:你的代理程式無需更強大的模型也能進步。重點摘要:規模為框架而非模型,訓練參數為0,包含8個可編輯的框架元件,版本0.1.0。執行環境為Linux、Python 3.12或3.13搭配uv,模型呼叫則透過Vertex AI。GPU需求未公開。效能方面:一次改良步驟即可在3個基準測試中,提升所有4個模型與框架組合的表現。最佳成果:GLM-5搭配OpenCode在WorkBuddy-Bench上從64.2提升至75.7(+11.5點);最差表現:GLM-5搭配Codex在JobBench上僅提升1.2點(23.6至24.8)。什麼是Harness²?它是Google研究推出的即插即用框架。

17 小時前
MarkTechPost AI模型更新

認識 Kyutai REKI:2.4B VLA 模型為機器人操控帶來高效記憶

Kyutai 與 Inria 及 École des Ponts 合作,推出了 REKI——一個用於機器人操控的 2.4B 參數視覺-語言-動作模型(VLA)。該模型僅使用公開數據進行預訓練,並配備了輕量級的近期記憶功能。在三個分佈外基準測試中,僅有規模約為其兩倍的模型能超越它。所有模型權重已於今日在 Hugging Face 上公開。核心資訊:規模:2.4B 參數(2.2B Qwen3.5-2B VLM + 0.2B 流匹配動作專家)。記憶涵蓋最近 3 幀,間隔 1 秒。運行環境:在 1 張 NVIDIA H100 上進行基準測試。從兩個 256×256 攝像頭輸入,編譯後每個動作區塊耗時 21.8 毫秒。權重以 BF16 格式提供,暫無量化版本。性能:在 LIBERO-Plus 和 RoboTwin Clean2Rand 基準測試中,為公開數據預訓練的 VLA 模型中最優;在 LIBERO-Plus 上達到 90.4% 的最高分。

1 天前
MarkTechPost AI模型更新

DeepSeek 發布 V4.1-Flash-1017,DeepSWE 得分 77.0,並開放搜尋 API

DeepSeek 剛發布 DeepSeek-V4.1-Flash-1017,這是其 V4.1-Flash 模型的新檢查點,現已在 DeepSeek 網站、應用程式及 API 上線。DeepSeek 宣稱該版本在性能、任務完成速度與輸出簡潔度上均優於 9 月發布的 V4.1-Flash,並稱之為性能與成本的帕累託改進。同時,DeepSeek 也向所有開發者開放了搜尋與擷取 API。對代理建構者而言,這意味著更便宜的編碼模型加上單一 API 金鑰即可使用的第一方網路層。重點摘要:骨架參數 552B,另加 196B 的 Engram 參數;預填充階段每 token 啟用 8B 參數,解碼階段啟用 16B 參數;上下文長度達 1M tokens,最大輸出 384K tokens。運行於 DeepSeek API 的 deepseek-flash 模型。9 月版的 V4.1-Flash 權重(763B 參數,FP8)採 MIT 授權。

1 天前
MarkTechPost AI模型更新

2026年20款Jev替代方案:挑戰TypeSafe的決策模型

TypeSafe於2026年9月15日推出Jev,這是一款決策模型而非聊天機器人。使用者可定義允許的答案,Jev將回傳標籤、分數或是否的機率。約4週內,至少20款Jev替代方案相繼問世,來自Cloudflare、OpenAI、Perplexity、Liquid AI、AWS的Strands Labs及獨立開發者。本指南比較各方案在規模、授權、硬體、價格、Jev API相容性及已發布基準測試的表現。重點摘要:規模範圍從287M(GLiNER2.5-multi-Decide)到35B-A3B(Mapika Decider),Jev規模未公開。執行環境:Von和Laya等編碼器可在CPU上運行,4B適配器適用24 GB GPU或32 GB Mac。效能:多數開源模型在困難推理上落後Jev,但在狹窄分類任務上數款與之匹敵或超越。最佳表現:Cloudflare Clef在BANKING7取得94.20分。

1 天前
雷峰網模型更新

長鑫科技市值兩月內跌去1萬億;阿里加碼AI硬件品牌,天貓、速賣通聯動;國行版蘋果AI有望12月上線,百度、阿里參與合作丨雷峰早報

要聞提示1.長鑫科技市值兩月內跌去1萬億2.年內已至少18次故障!DeepSeek發放宕機補償,有人拿到3000元3.阿里加碼AI硬件品牌,天貓、速賣通聯動4.國行版蘋果AI有望12月上線,百度、阿里參與合作5.可靈AI新一代模型Kling 4.

2 天前