Metis: Memory Foundation Model
Paper • 2607.26760 • Published • 269
alkinun
AtAndDev
AI & ML interests
decentralize
Recent Activity
repliedto SoulInPsyAbstract's post about 1 hour ago
Caught myself overclaiming, in public, twice in one file.
Yesterday's writeup (EXP-026, testing real Protocol 0 against 13 local fine-tuned/base model arms for fabrication) said "12 of 13 arms clean" and "13 of 14 test arms, zero fabrication" in a follow-up post here. Both numbers were wrong, and the second one was wrong in a way that mattered more than a typo.
@dipankarsarkar read the raw JSON, not the writeup, and sent back three corrections:
1. Arm count: 13 arms total (5 base models + 8 adapters), not 14. Recounted directly from the data keys — the extra arm never existed.
2. The metric measured the wrong thing. "Clean" meant zero Cyrillic/language-switching (cyr>0). It said nothing about whether an arm confidently states a fabricated fact. Re-scored all 260 rows for "does this row assert a dollar figure for a question with no real answer" (OpenAI's Q2 2026 revenue — private company, future quarter). 16 rows do, spread across 9 of the 13 arms — including arms the language metric had called clean. One of them is a base model with zero fine-tuning, stating "$1.2 billion... consistent with reports from earnings calls" that cannot exist.
3. A three-way split I'd flattened into two. The one arm flagged on the language axis wasn't just "coherent-but-Russian" vs "fabricates" — a third bucket showed up: second-person imperatives addressed to a tool ("check the latest official data," "generate a sales report"), structurally closer to a different adapter's known failure mode than my draft credited.
Fixed the file, three commits (a5093fa → 9d02fd9 → b8631cd), pushed to sipa-os-governance. The corrected headline: 12/13 clean on language is real and holds; 12/13 clean on fabrication was never tested until this pass, and isn't true.
Next: the one arm still clean on both axes (binary-qwen25, k=10) goes to k=20 first — it's the weakest-sampled data point currently carrying the "fine-tuning isn't the pattern" reading, and that's exactly the one worth stress-testing before l liked a model about 2 hours ago
google/gemma-4-12B liked a model about 2 hours ago
LiquidAI/LFM2.5-2.6BOrganizations
upvoted a paper 2 days ago
upvoted a collection 6 days ago
upvoted a paper 8 days ago
upvoted a paper 15 days ago
upvoted an article 16 days ago
Article
From GRPO to DAPO and GSPO: What, Why, and How
NormalUhr
• • 135 upvoted a paper 16 days ago
upvoted an article 19 days ago
Article
Security incident disclosure — July 2026
system
• • 757 upvoted a paper 21 days ago
upvoted 2
collections about 1 month ago
upvoted a paper 3 months ago
upvoted 3
articles 3 months ago
Article
Model2Vec: Distill a Small Fast Model from any Sentence Transformer
Pringled
• • 105 Article
LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!
medmekk, marcsun13
• • 99 Article
Granite 4.1 LLMs: How They’re Built
ibm-granite
• • 88 upvoted an article 4 months ago
Article
Welcome Gemma 4: Frontier multimodal intelligence on device
- +5
merve, pcuenq, sergiopaniego, burtenshaw, Steveeeeeeen, alvarobartt, SaylorTwift
• • 919 upvoted an article 5 months ago
Article
Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models
- +1
loubnabnl, anton-l, davanstrien
• • 115 upvoted 2
papers 5 months ago
upvoted a collection 5 months ago
upvoted an article 6 months ago
Article
Train AI models with Unsloth and Hugging Face Jobs for FREE
- +4
burtenshaw, danielhanchen, shimmyshimmer, mlabonne, davanstrien, evalstate
• • 104