Tolerance panels · the instrument that judged every edit to this post
Green in-lane · amber a little out · red drift. Every panel is a real commit, byte-identical on recompute. Tap any panel to open its shareable receipt.
Geometric Driven Development — 1 measured edit to this post. Recompute any of them yourself: npx thetacog-mcp attest-demo
A
Loading...
🧨Why we believe this, as of this week
why we believe · the claim · the confession · the sidestep
We believe the strongest possible evidence that a verification method works is the method catching its own machine failing — twice in one week, in two different ways, and turning both failures into permanent guards. Not a benchmark. Not a demo built for a pitch. The actual production machine that writes, commits, and emails our work burned real money doing nothing, then shipped a nonsense artifact with a straight face — and the same decidable slice we have been describing all month is what caught both, priced both, and now prevents both. You cannot decide whether work is good. You can decide where it landed, whether the machine that produced it stayed in its lane, and what that lane-keeping looks like over time. This week that stopped being an argument and became a receipt trail you can click.
If you run agents — coding agents, back-office agents, anything autonomous enough to spend money while you sleep — this post is the shape of the control you are missing, demonstrated on the people selling it.
what happened · what it cost · your connection to this machine
For roughly thirty-four hours, a scheduled job on our machine woke every five minutes, spawned a full flagship-model session, searched the inbox, concluded "no new reply," and died. Two hundred and eighty times. Each run re-verified the same already-answered email. The work was flawless — every single run reached the correct conclusion. It was also worthless, and at flagship pricing it consumed about $665 in token-equivalent value producing nothing.
Here is the part worth your attention: no quality check could have flagged this. Every run succeeded. The output was correct. An LLM judge would have graded it highly. The failure was not in the work — it was in the placement of the work: an expensive reasoning engine occupying a lane that belongs to a free shell script. The fix was not better prompting; it was structural. The "is there anything new?" question moved into bash and SQLite where it costs zero, the model was demoted to a worker summoned only when the database proves there is a command to execute, and a regression test now fails the build if any scheduled job ever again calls a model without pinning which one. Daily cost telemetry — itself model-free — now emails the burn every morning. The incident, forensics, and fix are public in the repo's ops log.
Off-target work done well is the failure your quality stack cannot see. Every one of those 280 runs passed. The lane was wrong, not the work — and lane is the thing that is decidable.
🧨💸 B → C 🕳️
C
Loading...
🕳️The second failure: exit-zero is not a proof of sense
the empty artifact · the gate's contribution · rules as rows, not prose
Days later the machine failed differently. Every commit here emails a drift receipt whose leading image is the competence shape — the tolerance map with each cluster of activity ringed and named. A data-only commit came through with nothing semantic to map, the region detector correctly found zero regions, and the renderer dutifully drew an empty black square — which the pipeline then emailed as the headline proof image. The pipeline ran fine. Exit code zero. The artifact was nonsense.
The fix generalizes further than the bug. Send-gates now live as rows in SQLite, next to the rules the prompt lens already reads — an artifact with zero regions is suppressed, the receipt continues honestly as direction-only, and the trip is recorded in a ledger, because a nonsense result does not mean "skip it," it means the pipeline regressed and the trip is the alarm. The escalation contract is written into the same table: gates run deterministic and free, sorted by relevance to the lane; a model steps in only when a gate trips — the repair worker, never the checker. Then we made the fix prove itself: the very commit that documented the new rule went through the same pipeline, and its receipt arrived with a fully populated shape — green in-lane clusters, amber bleed, zero red. The fix's own receipt is the evidence it works.
A pipeline that runs without error can still produce nonsense. Deterministic infrastructure needs decidable sense checks — and those checks belong in data, where every pipeline reads the same rulebook, not in prose that each script remembers differently.
🧨💸🕳️ C → D 🔭
D
Loading...
🔭The asymmetry: generally correct is not correct here
why rules beat priors · the growth of the rulebook · measured, not asserted
Both failures share a root. A capable general intelligence — human or model — defaults to the generally correct move: poll with the powerful tool, ship the artifact the pipeline produced. Hallucination, in the way that actually costs money, is mostly this: the generally-correct answer applied to a situation that is deliberately different. Our repo is deliberately different in a hundred ways, and each difference exists because the general default already failed here once.
So the counterweight is a rulebook the machine consults before acting: a prompt-time lens that places every request on a 144-anchor competence lattice — deterministically, no model in the verdict, in tens of milliseconds — and injects the handful of rules that are load-bearing for that exact lane. This week the rulebook grew from thin to real: 32 domains, 134 rules, each rule the fossil of a paid-for mistake. And because we measure rather than assert: audited over this week's own session, the lens routed correctly roughly half to two-thirds of the time, its known failure mode is vocabulary collision, and its background proposer caught the worst misroute on its own. Those numbers are honest, they are improving, and the measurement harness that will tighten them is running as a delegated track with its own receipts.
🧨💸🕳️🔭 D → E 👣
E
Loading...
👣Role continuity: the footprint an honest agent leaves
actor and patient · the repeated footprint · the uncertainty we carry openly
Here is the discovery that turns all of this from hygiene into a product. Every commit receipt selects an actor — the anchor where the commit's stated intent concentrates, found by a damped attractor over the intent's mass — and a patient, the anchor that actor most strongly grips. Reviewing a full day of receipts, the actor-to-patient pairs across fourteen commits landed on ten distinct anchors — the selector is not degenerate — but the three commits that were genuinely the same work converged on the same pair: strategy-of-the-spec directing operations-of-the-pipeline. The system read a day of varied work correctly and recognized the deep sameness inside it.
That repetition is the signal. An agent staying in its role leaves a repeated actor-to-patient footprint; a lane-jump breaks the series. Continuity of that footprint over time — not any judgment about quality — is measurable, continuous, physical, and cheap to verify. You do not need to trust the agent, its vendor, or a judge model. You watch the footprint. One honest caveat, because unmeasured claims are how this industry got here: before continuity can be sold as a ranking, the selector itself must be proven unbiased — the test is running the actor-pick on scrambled versus intact commit messages and confirming the attractor follows the content, not the boilerplate. That test is queued in the same delegated track, and the metric does not ship without it.
For a risk buyer this is the whole pitch in one line: you cannot underwrite a philosopher, but you can underwrite a lane — and role continuity is the lane, observed longitudinally, signed at every step.
🧨💸🕳️🔭👣 E → F 📈
F
Loading...
📈What this buys you, and what it costs us to say so
the certainty of the series · the significance for you · the evidence · the to-do
Everything above compounds into one artifact: a time series of placement receipts per agent — where it worked, whether it stayed in lane, how turbulently the lane moved — signed, append-only, and recomputable by a stranger on a laptop. From that series come the numbers a market needs: a breach frequency (ours runs live and public — currently about one commit in seven leaves its lane, with an honest confidence interval around it), and a lane volatility that a desk can quote. The gates this week exist precisely to keep nonsense out of that series, because a single poisoned entry costs more credibility than a hundred clean ones earn. What it buys you: if your agents produced this series today, you would know within one day — not one invoice cycle — when one of them starts burning money confirming nothing, and you would have the artifact an insurer, an auditor, or your own board can actually check.
The uncertainty we carry openly: the lens misroutes on vocabulary collisions, code-heavy commits still grip the sensor weakly, and the continuity metric awaits its bias test. Every one of those is a measured gap with a delegated owner and a guard on the way — which is the only definition of "being fixed" we accept anymore. The certainty: the walk is real silicon, the verdicts are model-free, the receipts recompute, and the whole week described here is public in the commit log — the machine proving itself is not a metaphor, it is the release process.
Do this: run npx thetacog-mcp attest-demo and watch a placement verdict compute on your own hardware in about ninety seconds. If you hold risk — yours or other people's — the standing conversation is at thetadriven.com/dinner. If you just want the thesis from first principles, start at Are you out of your pixel? — or read the two posts this one stands on: The Laboratory Specimen on why the meaning stays undecidable, and One Ruler, Two Markets on pricing the lane.