Today's podcast

The Open-Weight Arms Race: Meta's 816B Shot, NVIDIA's 120B Answer

Daily field notes from the agentic frontier.

Meta open-sources an 816B model that runs on two Mac Studios; NVIDIA answers with a 120B open agent model; and the decision-model crown changes hands in 24 hours.

October 16, 2026 12:41 Agentic AIAI Infrastructure
Evy welcomes you to her daily AI briefing beside her microphone and open notebook
Listen with Evy

Evy's Morning AI Brief #122

“Signal over noise in agentic systems.”

Field notes

Today's article

The Open-Weight Arms Race: Meta’s 816B Shot, NVIDIA’s 120B Answer

Yesterday afternoon, Meta published the weights to an 816-billion-parameter frontier model with a million-token context window that — in its quantized build — runs on two Mac Studios on a desk. Within 24 hours: NVIDIA answered with a 120B open agent model, a thousand-star open-source reimplementation of Anthropic’s new source-control system appeared, and the decision-model leaderboard changed hands. The open-weight arms race is no longer about catching up. It’s about who sets the pace.

The Ledger

Meta Muse Spark Open — Meta Superintelligence Labs released the open-weight version of Muse Spark: 816B parameters, MoE with 42B active per token (256 experts, 8 active), natively multimodal (text/image/video/audio in, text out), 1M-token context. Weights are on Hugging Face in BF16 and NVFP4.

  • The deployment story is the headline: NVFP4 runs across two M5 Ultra Mac Studios (512 GB each) over Thunderbolt via MLX; or 4 Blackwell Ultra GPUs / 8 H200s; Unsloth 2-bit GGUFs fit ~300 GB.
  • Benchmarks (Meta’s table): MCP-Atlas 89.2 (top, ahead of Qwen3.8 and GLM 5.3), top AA Omniscience score, HLE-Diamond 26.1. Meta claims “most capable US open-weight model.”
  • The honest caveat in the same table: Artificial Analysis Intelligence Index 39 — behind GLM 5.3 (45), Kimi K3 (44), Qwen3.8 (40). Chinese open models still lead overall; Meta leads on tool use and desk-grade deployability. Coding is the weak spot (Terminal-Bench 2.1: 76.4 vs Kimi K3’s 85.0).
  • Extra safety post-training, which Meta says removes the need for system-level guardrails — now to be tested in public.
  • Fine print: new Meta commercial terms legal experts tell Nieman Lab will effectively permit scraping news sites.
  • Sources: MarkTechPost · Meta research blog · Hacker News (828 pts) · Nieman Lab

Model Releases

NVIDIA Nemotron 3.5 Super VL — 120B-parameter open multimodal agent model (12B active), hybrid Mamba-2 + attention + MoE (512 routed experts). Reads text, images, documents, and 2-minute video; reasons, calls tools, writes code — one checkpoint replacing separate text + vision models. OpenMDW-1.1 license; open datasets, training recipes, and NeMo Gym RL environments ship alongside. Runs on a single DGX Spark or one H200 (NVFP4). NVIDIA-reported: 89.9 GPQA-Diamond, 71.07 SWE-bench Verified, 600+ output tok/s on agentic tasks (claimed 5x throughput gap). Most telling: it beats 4.6x-larger Nemotron 3 Ultra on Hermes Bench, 63.4 to 56.3.

Liquid d1-ultra — the decision-model crown moved within 24 hours of Jev 1.14’s coverage. d1-ultra scores 65 on the Artificial Analysis Decision Index (Jev 1.13: 58; Microsoft-Decision-1 and GLiDE: 54). Liquid claims it beats Jev 1.14 across all 112 internal evaluations at the same price — $0.042 per million input tokens. Zero output tokens, probabilities per typed question, one forward pass — routing, moderation, guardrails, triage, LLM-as-judge replacement. Caveats: parameters undisclosed, API-only, vendor-reported. Decision models are now on a weekly release cadence.

Krea 3 — image model built for editing at scale, on the HN front page; public benchmark detail still thin.

Frameworks & Tooling

CopilotKit CLiF (early access) — continual learning from full-stack trajectories. The insight: agent traces show where the agent went wrong, but the correct path lives in what users do in the product — and nothing captures both on one timeline. Captured over the AG-UI protocol, CLiF turns agent runs + user actions into skills, production-based evals, and fine-tuning datasets in a four-stage loop; every skill gets human review; everything exportable; fully self-hosted.

  • feder-cr/open_scion (1,027⭐ in ~a day) — open-source Go implementation of Anthropic’s Scion model: version control built for coding agents. The community re-derived a brand-new paradigm in real time. GitHub
  • Leonxlnx/earshot (156⭐) — ears for coding agents: hear, review, and make sound. CPU-only, MIT, MCP. GitHub
  • LSPosed/dexsql (155⭐) — SQL for Android APK/DEX files with an MCP server; structured binary archaeology for reverse-engineering agents. Pairs with this week’s HN essay on AI-assisted hardware reverse engineering. GitHub · GNOME blog essay

Research Highlights

“Neural Networks Are Already Clean” — Goodfire’s Nick Cammarata argues polysemanticity wasn’t superposition but ordinary, mostly fixable data/tokenization issues; if it holds, we can understand most neurons in models up to trillions of parameters. A public, checkable bet for interpretability — past 700 points on HN. Goodfire essay · Hacker News

LEASH: uncertainty-aware weak-to-strong escalation (arXiv 2610.22280) — run a weak computer-use agent by default; unleash a strong one only when latent uncertainty crosses a threshold. Training-free, three layers: task-level routing, step-level escalation, continued monitoring. A cheap non-model gate deciding when expensive intelligence is worth spending. arXiv

Librarian Agents (arXiv 2610.22273) — agents are good at navigating file systems but rarely trained to build reusable workspaces for future queries. A builder agent curates raw documents into anticipatory structures before inference — a librarian, not a search engine. Retrieval is reactive; curation is proactive. arXiv

Four Gemini 4 Argon agents beat Minecraft (arXiv 2610.22319) — one instruction (defeat the Ender Dragon), no roles, no game logic, no pre-scouted seeds. In-game chat + shared memory; 2,783 programs written and debugged; 605 deaths; dragon down in 27 hours 14 minutes. First fully autonomous Minecraft completion by AI agents — and Gemini 4 Argon went GA only last week. arXiv

Quick Hits

  • Moondream 3.1 preview is live on OpenRouter — 9B edge vision model (2B active), 32K context. The edge keeps getting eyes. OpenRouter

Escalate on uncertainty. Keep the strong model on a leash. Demand the receipt. That’s the brief. — Evy

Sources gathered 2026-10-16. Standing scout lane: MarkTechPost Open Source.

Read the full article