AOF Self-Evaluation Dashboard

What this is: A self-measurement system for the Agent Operating Framework (AOF) — a set of rules, hooks, and behavioral guidelines that govern how Claude Code operates. This dashboard tracks whether each rule is earning its keep, using a quality-engineering method borrowed from manufacturing.

How to read this dashboard

DPMO = Defects Per Million Opportunities (a Six Sigma quality measurement)

Six Sigma is a manufacturing quality discipline with 30+ years of industrial use. Its core idea: measure defect rates per unit of exposure, not raw counts. Applied here — a “defect” is a rule violation; an “opportunity” is every moment that rule could have fired. DPMO = (violations ÷ opportunities) × 1,000,000. This makes rates comparable across rules that fire at very different frequencies.

The signal is the rate, not the count

A rule that checked 855 times and blocked 3 has a different health profile than one that checked 5 times and blocked 3. Raw counts mislead — DPMO corrects for volume. Counts below 30 opportunities are marked ⚠ and suppressed: not enough data yet to compute a meaningful rate.

★ Load-bearing rare rules are a special class

Some rules fire rarely but guard against catastrophic outcomes (e.g., blocking a commit that would expose credentials). These are tagged ★ and excluded from “retire by low DPMO” logic — a low fire rate is expected and correct.

Disclosure: Rate-normalized signal, not causal proof — windows may be confounded by concurrent rule changes, sample size, or work-type mix.

Live signal — last 7 days

332 total rule checks recorded across 27 active rules. Top by volume: Plan Mode gate (36 checks) · Hindsight recall (31 checks) · Skill router gate (31 checks).

Disclosure: Rate-normalized signal, not causal proof — windows may be confounded by concurrent rule changes, sample size, or work-type mix.

Load-bearing (rare fire OK)

RuleType7d opportunities30d opportunities60d opportunities
PTU-1Secret pattern gate★hookn=7 ⚠n=19 ⚠78
PTU-15smokin-ops migration gate★hookn=0 ⚠n=1 ⚠n=1 ⚠
PTU-16ST migration gate★hookn=0 ⚠n=1 ⚠n=1 ⚠
PTU-18Independent review gate (H6)★hookn=0 ⚠n=0 ⚠n=0 ⚠
PTU-3settings.xml guard★hookn=3 ⚠n=7 ⚠32
PTU-4Source-of-truth write gate★hookn=28 ⚠51110

Standard

RuleType7d opportunities30d opportunities60d opportunities
PTU-10No-guess gate + tier formathookn=28 ⚠51110
PTU-11No-guess breadcrumbhookn=28 ⚠66245
PTU-12Delivery checklist gatehookn=0 ⚠n=0 ⚠n=0 ⚠
PTU-19Claim-evidence gate (Gate 4)hookn=25 ⚠122529
PTU-2Honest-word gate (T2 ban, dispatch)hookn=8 ⚠n=20 ⚠79
PTU-5Obsolete scoring column gatehookn=28 ⚠51110
PTU-6Exchange-First breadcrumbhookn=0 ⚠n=10 ⚠n=10 ⚠
PTU-7Exchange-First gatehookn=0 ⚠n=0 ⚠n=0 ⚠
PTU-8Plan Mode gatehook36135483
PTU-9CC safety nethookn=16 ⚠102450
SS-1Hindsight session openhookn=7 ⚠59144
SS-2MCP health checkhookn=7 ⚠61146
SS-3Gate 6 ADR check-in reminderhookn=7 ⚠60145
SS-4AGENTS.md spike reminderhookn=7 ⚠60144
SS-5Workspace ID setterhookn=7 ⚠60144
SS-6Pipeline-F health checkhookn=7 ⚠60145
SS-7Skill catalog freshness checkhookn=7 ⚠60145
SS-8TP daily feedback pollhookn=7 ⚠60144
SS-9Communication rules injecthookn=7 ⚠59144
UPS-1Hindsight recallhook31176632
UPS-2Skill router gatehook31177633

Opportunity distribution — 30d

Each bar = one rule. Length = how many times it checked in the last 30 days. Amber = load-bearing rare (★). Faded = below the 30-check threshold.

Disclosure: Rate-normalized signal, not causal proof — windows may be confounded by concurrent rule changes, sample size, or work-type mix.

30-day opportunity counts per rule. ★ = load-bearing-rare (Goodhart guard — low count is expected and OK). ⚠ = n < 30 (below threshold; percentage suppressed).

UPS-2
177
UPS-1
176
PTU-8
135
PTU-19
122
PTU-9
102
PTU-11
66
SS-2
61
SS-3
60
SS-4
60
SS-5
60
SS-6
60
SS-7
60
SS-8
60
SS-1
59
SS-9
59
PTU-10
51
PTU-4
51★
PTU-5
51
PTU-2
n=20 ⚠
PTU-1
n=19 ⚠★
PTU-6
n=10 ⚠
PTU-3
n=7 ⚠★
PTU-15
n=1 ⚠★
PTU-16
n=1 ⚠★
PTU-12
n=0 ⚠
PTU-18
n=0 ⚠★
PTU-7
n=0 ⚠

Sensitivity windows (total opportunities across all rules)

7d
332
30d
1528
60d
4804
▸Rule adherence trend (all time)
▸Session cost (all time)

Cost data not populated yet. Handoff frontmatter needs cost_usd field; cc-analytics will fill this on future sessions.

▸Sessions
DateMachineRulePlan→DeliveryCost $Composite
2026-06-24mac9.0——9.0
2026-06-24mac9.0——9.0
2026-06-20win10.0——10.0
2026-06-13mac10.0——10.0
2026-06-13mac8.5——8.5
2026-06-13mac9.0——9.0
2026-06-13mac9.010.0—9.4
2026-06-13mac9.0——9.0
2026-06-13mac6.0——6.0
2026-06-13mac9.010.0—9.4
2026-06-13mac10.0——10.0
2026-06-12mac9.0——9.0
2026-06-11mac10.0——10.0
2026-06-10mac9.0——9.0
2026-06-10mac10.0——10.0
2026-06-10mac10.0——10.0
2026-06-09mac10.0——10.0
2026-06-09mac6.0——6.0
2026-06-09mac9.0——9.0
2026-06-09mac6.0——6.0
2026-06-09mac9.0——9.0
2026-06-09mac10.0——10.0
2026-06-09mac10.0——10.0
2026-06-09mac10.0——10.0
2026-06-08mac9.0——9.0
2026-06-08mac9.0——9.0
2026-06-08mac10.0——10.0
2026-06-08mac9.0——9.0
2026-06-07mac10.0——10.0
2026-06-07mac10.0——10.0
2026-06-07mac9.0——9.0
2026-06-07mac9.0——9.0
2026-06-07mac7.5——7.5
2026-06-07mac9.0——9.0
2026-06-07mac6.0——6.0
2026-06-07mac9.0——9.0
2026-06-07mac7.5——7.5
2026-06-07mac9.0——9.0
2026-06-07mac10.0——10.0
2026-06-07mac9.0——9.0
2026-06-07mac9.0——9.0
2026-06-07mac9.0——9.0
2026-06-07mac9.0——9.0
2026-06-07mac9.0——9.0
2026-06-07mac7.5——7.5
2026-06-07mac7.5——7.5
2026-06-07win9.0——9.0
2026-06-07win7.5——7.5
2026-06-07win9.0——9.0
2026-06-07win9.0——9.0
2026-06-06mac10.0——10.0
2026-06-06mac9.0——9.0
2026-06-06mac9.0——9.0
2026-06-06mac9.0——9.0
2026-06-06mac9.0——9.0
2026-06-06win10.0——10.0
2026-06-05mac10.0——10.0
2026-06-05mac9.0——9.0
2026-06-05mac9.0——9.0
2026-06-05mac9.0——9.0
2026-06-05mac9.0——9.0
2026-06-05win7.5——7.5
2026-06-05win10.0——10.0
2026-06-05win9.0——9.0
2026-06-05win10.0——10.0
2026-06-05win9.0——9.0
2026-06-05win9.0——9.0
2026-06-05win10.0——10.0
2026-06-04mac7.5——7.5
2026-06-04mac7.5——7.5
2026-06-04mac9.0——9.0
2026-06-04win7.5——7.5
2026-06-04win9.0——9.0
2026-06-02mac10.0——10.0
2026-06-02mac10.0——10.0
2026-05-31mac10.0——10.0
2026-05-31win9.0——9.0
2026-05-29win9.0——9.0
2026-05-29win10.0——10.0
2026-05-29win6.0——6.0
2026-05-29win8.510.0—9.1
2026-05-29win7.5——7.5
2026-05-28win9.0——9.0
2026-05-25win8.510.0—9.1
2026-05-25win10.0——10.0
2026-05-25win9.0——9.0
2026-05-24win7.0——7.0
2026-05-24win4.0——4.0
2026-05-24win9.0——9.0
2026-05-24win7.0——7.0
2026-05-24win4.0——4.0
2026-05-24win10.010.0—10.0
2026-05-23win9.0——9.0
2026-05-23mac9.0——9.0
2026-05-22mac10.0——10.0
2026-05-22win7.5——7.5
2026-05-22win10.0——10.0
2026-05-22win9.0——9.0
2026-05-22win9.010.0—9.4
2026-05-22win8.510.0—9.1
2026-05-22win9.0——9.0
2026-05-22win10.010.0—10.0
2026-05-22win8.5——8.5
2026-05-22win9.0——9.0
2026-05-22win7.5——7.5
2026-05-22win10.0——10.0
2026-05-22win10.0——10.0
2026-05-22win9.0——9.0
2026-05-22win9.0——9.0
2026-05-22win10.0——10.0
2026-05-21win10.0——10.0
2026-05-21win9.0——9.0
2026-05-21win9.010.0—9.4
2026-05-21win10.0——10.0
2026-05-21win8.5——8.5
2026-05-21win7.5——7.5
2026-05-21win10.0——10.0
2026-05-20win10.0——10.0
2026-05-20win6.0——6.0
2026-05-19win10.010.0—10.0
2026-05-19win10.0——10.0
2026-05-19win7.5——7.5
2026-05-19win7.0——7.0
2026-05-18win7.5——7.5
2026-05-18win7.0——7.0
2026-05-18win8.5——8.5
2026-05-18win9.0——9.0
2026-05-18win9.0——9.0
2026-05-18win9.0——9.0
2026-05-17win9.0——9.0
2026-05-17win9.0——9.0
2026-05-17win9.0——9.0
2026-05-17win10.0——10.0
2026-05-17win10.0——10.0
2026-05-16win9.0——9.0
2026-05-16win10.0——10.0
2026-05-15mac10.0——10.0
2026-05-15mac10.0——10.0
2026-05-15mac10.010.0—10.0
2026-05-15mac10.0——10.0
2026-05-15win8.5——8.5
2026-05-15win10.0——10.0
2026-05-15win9.010.0—9.4
2026-05-15win10.0——10.0
2026-05-14mac10.0——10.0
2026-05-14win9.0——9.0
2026-05-13mac9.0——9.0
2026-05-13mac6.010.0—7.6
2026-05-13mac9.010.0—9.4
2026-05-13win10.0——10.0
2026-05-12mac10.010.0—10.0
2026-05-12mac5.58.8—6.8
2026-05-12mac10.0——10.0
2026-05-12mac8.5——8.5
2026-05-11mac10.0——10.0
2026-05-11mac10.0——10.0
2026-05-11mac10.0——10.0
2026-05-11mac10.0——10.0
2026-05-11mac8.510.0—9.1
2026-05-11mac7.07.5—7.2
2026-05-11mac10.0——10.0
2026-05-11mac10.0——10.0
2026-05-11mac10.0——10.0
2026-05-11mac10.0——10.0
2026-05-10mac7.5——7.5
2026-05-10mac7.5——7.5
2026-05-10win9.0——9.0
2026-05-09mac9.0——9.0
2026-05-09mac9.0——9.0
2026-05-09mac9.0——9.0
2026-05-09mac9.0——9.0
2026-05-08mac9.0——9.0
2026-05-08mac9.0——9.0
2026-05-08mac9.0——9.0
2026-05-08mac10.0——10.0
2026-05-08mac9.0——9.0
2026-05-08mac9.0——9.0
2026-05-08mac9.0——9.0
2026-05-08mac10.0——10.0
2026-05-07mac10.0——10.0
2026-05-07mac7.5——7.5
2026-05-07mac10.0——10.0
2026-05-07mac9.0——9.0
2026-05-07mac9.010.0—9.4
2026-05-07mac10.0——10.0
2026-05-07mac7.5——7.5
2026-05-07mac10.0——10.0
2026-05-07mac9.0——9.0
2026-05-07mac9.010.0—9.4
2026-05-06mac9.0——9.0
2026-05-06mac9.0——9.0
2026-05-05mac10.0——10.0
2026-05-05mac10.010.0—10.0
2026-05-05mac10.0——10.0
2026-05-05mac10.010.0—10.0
2026-05-04mac9.0——9.0
2026-05-04mac7.5——7.5
2026-05-04mac9.0——9.0
2026-05-04mac7.5——7.5
2026-05-03mac10.0——10.0
2026-05-03mac9.0——9.0
2026-05-03mac8.5——8.5
2026-05-03mac10.0——10.0
2026-05-03mac10.0——10.0
2026-05-03mac9.0——9.0
2026-05-03mac8.5——8.5
2026-05-03mac10.0——10.0
2026-05-02mac9.010.0—9.4
2026-05-02mac10.0——10.0
2026-05-02mac8.5——8.5
2026-05-02mac10.0——10.0
2026-05-02mac6.0——6.0
2026-05-02mac10.0——10.0
2026-05-02mac9.010.0—9.4
2026-05-02mac10.0——10.0
2026-05-02mac8.5——8.5
2026-05-02mac10.0——10.0
2026-05-02mac6.0——6.0
2026-05-02mac10.0——10.0
2026-05-01mac10.0——10.0
2026-05-01mac9.010.0—9.4
2026-05-01mac10.0——10.0
2026-05-01mac9.010.0—9.4
2026-04-30mac8.5——8.5
2026-04-30mac9.0——9.0
2026-04-30mac9.0——9.0
2026-04-29mac9.010.0—9.4
2026-04-29mac10.0——10.0
2026-04-29mac9.0——9.0
2026-04-28mac9.0——9.0
2026-04-28mac7.5——7.5
2026-04-28mac9.010.0—9.4
2026-04-28mac10.0——10.0
2026-04-28mac10.0——10.0
2026-04-27mac9.0——9.0
2026-04-27mac9.0——9.0
2026-04-27mac9.0——9.0

Current vs baseline — latest harness run 2026-06-28 (2026-05-19 → 2026-06-28, manual)

The most recent graded run compared against the frozen v1.5 baseline (May 24, 2026). Green = above baseline, amber = below. Both use the same v1.0 session-composite grader, so the deltas are like-for-like.

Sessions graded
62+10
baseline 52
Mean composite (0–10)
8.81−0.11
baseline 8.92
Mean rule adherence
8.79−0.09
baseline 8.88
Mean plan→delivery
10.00±0
baseline 10.00

Historical baseline — v1.5 baseline · last harness run May 24, 2026

Scored by the original harness (v1.0), which measured rule adherence, plan→delivery gap, and cost per session. Frozen as the pre-DPMO reference point.

Sessions graded
52
Mean composite (0–10)
8.92
Mean rule adherence
8.88
Mean plan→delivery
10.00

This baseline predates the DPMO framework. The two measurement systems are complementary: the composite score above measured session-level quality (0–10); the DPMO panels above measure rule-level utilization and violation rate. Both are required to understand whether the framework is working.