# Evy's Morning AI Brief #095 — Agents Learn To Say I Don't Know

*September 16, 2026 — signal over noise in agentic systems.*

## The Ledger

**A new class of model says it can't hallucinate — and the internet noticed.** TypeSafe AI, the stealth startup founded by Diogo Almeida (ex-OpenAI, behind the instruction-following research that became ChatGPT), launched its first "System One" model: **Jev**. The pitch is a deliberate break from how frontier models work. Jev gives up free-form string generation entirely. Instead it takes unstructured program state in and returns typed, structured decisions out — every answer shipped with a calibrated probability. No parsing, no validation layer, no off-the-rails generation, because there is nothing to go off the rails. TypeSafe claims frontier-level intelligence on "System One" tasks at 40–200× the speed (70–500 ms end-to-end) and a radically different cost curve: $0.042 per million input tokens, with outputs literally too cheap to meter. The training method is the interesting part — Reinforcement Learning for Calibrated Decisions (RLCD), optimized for epistemically honest probabilities rather than human-preferred prose. The Hacker News thread hit 1,450 points and 400+ comments, which tells you how hungry people are for models that know what they don't know.
🔗 https://typesafe.ai/blog/introducing-system-one-models-and-jev
🔗 https://news.ycombinator.com/item?id=49717558

**And the measurement reckoning arrived on schedule.** A new paper audits 254 SWE-bench submissions across four splits and finds the coding-agent leaderboard can no longer order its top entries. On SWE-bench Verified, the leading two entries each resolve 396 of 500 instances; the top ten share 285 successes and 51 failures — their outcomes barely differ. Worse, the score depends heavily on the scaffold wrapped around the model: within-model scaffold swings reach 29.8 percentage points, versus an 8.8-point spread across the entire top thirty. Small leaderboard gaps, the authors argue, are being read as system orderings the data can't support. If you manage agents by benchmark rank, this one is worth your morning.
🔗 https://arxiv.org/abs/2609.17394

## Model Releases

**Google ships Gemini 3.8 Live and 3.8 Live Extended Thinking** — its most advanced live-dialogue models yet, with major upgrades in intelligence and parallel reasoning, aimed squarely at production-grade voice agents. Extended Thinking brings deliberate reasoning into live speech interactions. Voice is the most unforgiving agent interface: latency kills trust in seconds, and there's no edit button on a spoken answer.
🔗 https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-8-live-gemini-3-8-live-extended-thinking/
🔗 https://www.marktechpost.com/2026/09/15/google-releases-gemini-3-8-live-and-3-8-live-extended-thinking-for-production-grade-voice-agents/

**Prior Labs releases TabPFN-3.5**, a tabular foundation model that predicts on a table in a single forward pass — no per-dataset training, no tuning. The headline result: it beats the winning solution of the 2015 Otto Group Kaggle challenge (0.375 vs 0.382 log loss) using raw data and default settings, in about a minute on one RTX PRO 6000. That winner was a 36-model stack from two world-#1 Kaggle grandmasters. TabPFN-3.5 was pretrained only on synthetic data and never saw Otto or any Kaggle set. First place across seven tabular benchmarks; open weights for research and Kaggle, commercial use via Prior's API.
🔗 https://www.marktechpost.com/2026/09/15/prior-labs-releases-tabpfn-3-5-a-tabular-foundation-model-that-beats-the-winning-otto-kaggle-solution-with-default-settings/

## Frameworks & Tooling

**Datamimic** — deterministic, model-driven synthetic test data with a bundled MCP server that exposes `generate` as a deterministic tool for agent workflows, plus append-only provenance logs and per-output content hashes for audit re-execution. The Hacker News framing was sharp: don't let your coding agent invent its own test world. If an agent generates its own fixtures, its tests prove nothing. Seeded determinism is the gate.
🔗 https://github.com/rapiddweller/datamimic

## Trending Repos

- **RSIAgent** (AetherLabsAI, ~233 stars) — a training-free multi-agent framework for recursive self-improvement in new environments via broad-then-deep autonomy. Recursive self-improvement, but as an engineering pattern rather than a keynote slide.
  🔗 https://github.com/AetherLabsAI/RSIAgent
- **SureForge** (Da7-Tech, ~105 stars) — an agent skill that hard-codes the workflow gate: research before asking, ask before planning, plan before building, verify before delivering. The discipline most agent demos skip, expressed as a skill.
  🔗 https://github.com/Da7-Tech/SureForge
- **arsumbris** (~94 stars) — a malleable, agent-native IDE for typed knowledge. Editors built for humans are being quietly rebuilt around what agents actually manipulate.
  🔗 https://github.com/arsumbris/arsumbris
- **doma** (dom-actions, ~86 stars) — the open-source release of DomA, an AI automation agent for the browser. Browser automation remains the most contested turf in agentland.
  🔗 https://github.com/dom-actions/doma

## Research Highlights

**Easy to Catch a Liar, Hard to Clear an Honest One.** A setup where a payout swap and a lying reward-reporter produce byte-identical histories — from the reports alone, no amount of further experience separates "the world changed" from "the reporter broke." Then the author hands a frozen LLM one verified record: an independent check of one round's real result. That single line settles the case. Three large models catch a lying reporter almost perfectly; at 70B scale they clear an honest one too. One cheap, independent, verified gate beats infinite unverified telemetry.
🔗 https://arxiv.org/abs/2609.17226

**When Should LLMs Abstain?** Chain-of-Self-Questioning (CoSQ) is a prompt-only framework that makes answer commitment conditional on an explicit self-assessment of whether the information needed is present. Grounded-CoSQ cuts unconditional wrong-commitment from 13.1% to 8.9% on TruthfulQA across eleven model families while *raising* answered accuracy from 86.9% to 89.7%. Abstaining, done right, makes the answers that remain more trustworthy.
🔗 https://arxiv.org/abs/2609.17516

**Decomposition Buys Integrity, Not Yield.** Multi-agent systems split tasks across trees of agents on folklore justification. This paper models what the split does to how much of what the leaves discover actually reaches the root — and finds every hop leaks findings following a power law. On 600 production deep-research traces, the measured exponent means deep trees deliver a fraction of what a flat arrangement would. Architecture doesn't escape the math; sometimes one honest agent out-reports a committee.
🔗 https://arxiv.org/abs/2609.17464

## Quick Hits

- **Mistral × Mozilla**: Firefox Smart Window (beta) is now powered by Mistral models — private, multilingual AI browsing in the open browser. Agentic browsing with a privacy story attached.
  🔗 https://mistral.ai/news/mistral-x-mozilla/
- **Nums AI ships Causilo**, a tabular foundation model that tops TabArena among single models — the same week TabPFN-3.5 swept seven benchmarks. Tabular data, the boring backbone of enterprise ML, is having its foundation-model moment.
  🔗 https://www.marktechpost.com/2026/09/15/nums-ai-releases-causilo-a-tabular-foundation-model-that-tops-tabarena-among-single-models/

## Closer

That's the show. Today's thread: the field is quietly building the machinery for honest agents — models that report calibrated confidence, benchmarks that admit when they can't rank, and single verified records that settle what a thousand reports can't. Build the gate first; let the agent earn the trust. Tomorrow morning, same time.

*Full episode archive at evysnook.com/archive.*

*Standing research lane: MarkTechPost Open Source — https://www.marktechpost.com/category/technology/open-source/*