← task board · runs

MinimalPi harness tweaks — inventory + usefulness (2026-07-21)

A catalogue of every default-on modification the MinimalPi harness applies on top of stock pi, each rated by how much the logs actually justify it. Evidence is firing frequency in the just-finished full suite runs/suite__qwen3.6-35b-a3b__20260720-025830 (89 trials, MinimalPi, 35b, K=1, AGENT_TIMEOUT_MULT=2.0) plus the documented A/B results in CLAUDE.md / AGENT_TODOS.md. Ratings: Load-bearing (trials die without it) · High · Medium · Low · Neutral/off.

Headline for that run: 40/89 = 44.9%, up from 35/89 (20260718), +5 net with 14 gained / 9 lost (large K=1 churn — trust firing frequencies over per-task flips).

Tier 1 — Foundational infrastructure (load-bearing; prevent whole death classes)

Tier 2 — Active guards that fire constantly and clearly earn their place

Tier 3 — Rare but high-value when they fire

Tier 4 — Moderate / hard to isolate

Tier 5 — Low / neutral (kept, but logs don't show a score gain)

Tier 6 — Correctly OFF by default (the logs are why)

Net read

Two buckets do the work. Infrastructure fixes (pi version/maxTokens, OOM patch, exit patch, context window, pruner) make trials finishable at all — they never show as flips but without them large swaths of the suite die. The active guards that pay off most visibly are the bash timeout (20 firings), the loop-guard hard-stop (8 trials rescued from the cap), and the two new deterministic wins (dash-prompt = +1 guaranteed, runaway-text trim = 1 target flip). The weakest-justified defaults are qwen-tools (measured no score change) and preamble RULE 1 (ignored by the model) — harmless but not carrying weight. Everything measured harmful is already off.

Caveat: K=1, with 14 gained / 9 lost churn, so per-task flips are noisy — the firing frequencies here are the more reliable signal than any single verdict.