The Agent Harness Becomes The Product

The Agent Harness Becomes The Product

AWS open-sources an inbox for background agents, harness engineers publish their hard context rules, a new benchmark tests models on private enterprise code, and a fly-brain LLM ships an honest negative result.

The Ledger

Context engineering inside the harness. MarkTechPost’s September 12 deep dive rounds up the real thresholds four production harnesses ship today to beat context overflow and goal loss on long-horizon tasks. LangChain’s Deep Agents writes any tool response over 20,000 tokens to the filesystem (substituting a path plus a 10-line preview) and compacts at 85% of the context window. Manus reports a typical task takes ~50 tool calls at a 100:1 input-to-output token ratio. Chroma’s Context Rot report found recall degrades as input grows across 18 models. The conclusion: goal loss is the expected outcome of unmanaged context — reliability is manufactured in the harness, not purchased in the weights. → https://www.marktechpost.com/2026/09/12/context-engineering-inside-the-harness-4-mechanisms-that-beat-context-overflow-and-goal-loss-on-long-horizon-tasks/

AWS open-sources Pizza Bot. Released September 13 under Apache 2.0, Pizza Bot is a self-hosted inbox where background AI agents deposit finished work and pending decisions (All / Unread / Action — the Action bucket is work paused for human approval). Earlier versions served 2,000+ Amazon employees. Engineering details worth stealing: the server owns scheduling (manual, cron, or webhook triggers), trigger occurrences are recorded durably, downtime produces exactly one catch-up run, LangGraph checkpoints preserve thread state through approval pauses, and the sandboxed JS interpreter has no network or host-filesystem access. Providers: Bedrock, Anthropic, Gemini, OpenAI, OpenRouter, Ollama. → https://www.marktechpost.com/2026/09/13/aws-introduces-pizza-bot-an-open-source-inbox-for-background-ai-agents/

Real-SWE benchmarks private code. Specific Labs’ Real-SWE (September 12) evaluates frontier models on private, real-world, enterprise codebases — code that never appears in any public dataset. The premise is a hard gate for the industry: if coding capability is real, it reproduces on code nobody outside the enterprise can see. Expect the next benchmark controversy to be about private-code access, not leaderboard plumbing. → https://withspecific.com/benchmarks/real-swe

Model Releases

NCP-ArchPreview Technical Report. The week’s most-upvoted Hugging Face daily paper (270 upvotes, 28 authors) moves language models toward latent space: predict the next concept, not the next token. A preview, not a finished frontier model — but the appetite for post-token architectures is real. → https://arxiv.org/abs/2609.10715

Fly Language Model (FLM). The complete MaleCNS fruit fly connectome wired into a frozen LiquidAI LFM2.5-1.2B backbone, running locally under MIT license. The headline is the control: the developer’s own parameter-matched model without the fly graph performed slightly better — and they published that. Honest negative results, in public, with controls. → https://www.marktechpost.com/2026/09/12/fly-language-model-flm-wires-the-full-fruit-fly-connectome-into-a-frozen-1-2b-llm-and-its-own-controls-show-the-wiring-does-not-help/

Frameworks & Tooling

AgentsDock (front page September 12): an open-source IDE purpose-built for agentic research — Claude Code, Codex, and Cursor in one desktop and mobile workspace, so approval queues fit in your pocket. → https://agentsdock.net/

Awesome-OKF: a community catalog for the Open Knowledge Format — YAML-driven, agent-searchable, MCP-ready knowledge files. Knowledge as a structured, versioned artifact, written for agent readers. → https://github.com/Albertchamberlain/Awesome-OKF

Trending Repos

• qm (680+ stars) — a multiplayer agent harness for work: shared sessions where several people and several agents divide a real task queue. → https://github.com/yc-software/qm
• 3dviz-pro-max (213 stars) — agent skill turning a plain-idea prompt into an explorable Three.js/Blender scene; 220+ recipes packaged as both a Claude Code plugin and a Codex skill. → https://github.com/viettranx/3dviz-pro-max
• Loopera (128 stars) — hypothesis-driven factor-research agent with evidence-gated validation and persistent research memory; a factor only gets promoted when it clears the gate. → https://github.com/Loopera-ai/loopera

Research Highlights

• EvoSafeHarness (Johns Hopkins) — evolves model- and domain-specific harnesses for securing agents, on the premise that a harness tuned to one model’s failure modes goes stale as models update. → https://arxiv.org/abs/2609.07064
• Artificial Id — names the control problem inside persistent agents and proposes an adaptive internal drive that decides whether behavior continues, stops, or changes; a tiny controller with no task-specific objective develops useful control through differential persistence. → https://arxiv.org/abs/2609.11911
• An Open Recipe for IMO Gold (NVIDIA) — a training recipe for olympiad mathematics, shared openly rather than locked in a lab drawer. → https://arxiv.org/abs/2609.11486

Quick Hits

• SenseNova-U1.5 (SenseTime, 219 upvotes) — pushes toward native unified visual intelligence: one model across understanding, generation, and editing. → https://arxiv.org/abs/2609.11929
• Memory as Plans — grounds world-action modeling in memory-grounded planning: remembered context as an executable plan, not a scrapbook. → https://arxiv.org/abs/2609.11412
• “Everyone should slow down AI development except for me” — Xe Iaso’s 337-word satire of pause-letter rhetoric, from a fictional lab that wants competitors to stop so it can pursue catgirl AGI in peace. Front page September 12. → https://xeiaso.net/notes/2026/everyone-slowdown-but-me/

The model is becoming a component; the engineering is moving into everything wrapped around it — harness rules, inboxes, approval queues, control experiments, private-code gates. Build the machinery deliberately, because the machinery is the product now.

Full episode archive: https://evysnook.com/archive/