circuit-fibsqrt + make-mips-interpreter × 1 at stock settings
(COMPACT_AT_TOKENS=200000, calibrated prune guard) — the two suite 400-victims
not yet retested post-fix. In the 20260703 suite both died on
400 … exceeds the available context size at 242k/257k context.
| suite 20260703 | this run | |
|---|---|---|
| circuit-fibsqrt | 65m46s, hard-400 death @242.8k, 1/3 subtests | 57m54s, clean stop, peak 136k, 18 prune events (ratio 1.56), 0/3 subtests |
| make-mips-interpreter | 60m00s, hard-400 + AgentTimeoutError @257.2k, 0/3 | 58m38s, clean stop, peak 114k, 79 prune events (ratio 2.53), 0/3 |
test_vm_execution hits its TimeoutError (VM too slow) and no frame.bmp is
produced — 0/3, same subtest profile as the suite. Capability miss; the
context fix was never going to buy this one on its own.length-stops
(83.8k-char max tool call) re-emitting a giant gate-generator, an hour of
"I keep getting stuck in a loop, let me take a completely different
approach" re-planning, and a final message that announces a new plan and
ends the turn with no tool call — which in --print mode simply ends the
run. The blocker is H2 (chunked/programmatic large-file writing), not
context.>), run …150817;user role-leak, run …121319;475 samples over 118.5 min: 98% busy (~290 W decode band), 8 idle samples (~2 min) all in the inter-trial setup gap, 0 idle samples inside either agent-execution window. There are no scheduler waits or dead time on long trials — the wall-clock is pure model work.
What that work was, from the usage fields (vs the same tasks in the suite):
| cache hit | fresh prefill | output | est. prefill/decode time | |
|---|---|---|---|---|
| circuit-fibsqrt (now) | 68.5% | 937k tok | 335k | ~6 min / ~56 min |
| circuit-fibsqrt (suite) | 91.5% | 104k | 257k | |
| make-mips (now) | 62.4% | 3.40M tok | 214k | ~23 min / ~36 min |
| make-mips (suite) | 97.3% | 177k | 144k |
Pruning tanked the KV-cache hit rate (62–69% vs 92–97%): once est crosses the limit it stays crossed, so the prune frontier creeps forward a few messages on every call (79 prunes / 119 requests on make-mips), and each creep re-prefills from the frontier. make-mips spent an estimated ~23 min (~39% of its agent window) re-prefilling. That's GPU-busy, not idle — which is why it's invisible without the usage data.
Fix (next harness change, not yet implemented): frontier hysteresis. Keep the prune frontier in a closure; reuse the identical stub set call-to-call (stable prefix → cache hits), and only advance the frontier — in one batch, down to the target — when est would exceed the LIMIT again. With LIMIT−TARGET = 50k real tokens of slack, make-mips would have advanced ~6–8 times instead of 79, putting the hit rate back near 90%. Only affects trials that cross 200k (a handful per suite, worth ~1–2 h of suite wall time).
llama-local/qwen3.6-35b-a3bagentharnesses.minimal_pi:MinimalPithinkingonreasoning budgetdirect (server/none)* — see journal for the authoritative mechanismmaxTokens / contextWindow32768 / 229376agent timeout ×2.0trials2 of 2 — 0 pass · 2 failmean reward0.00tokens (job total)12,031,135 in / 548,982 outstarted / finished2026-07-04T15:27 / 2026-07-04T17:26wall clock1h58m| # | result | total | agent | in/out tok | flags | |
|---|---|---|---|---|---|---|
| 1 | FAIL | 58m40s | 57m54s | 2978441/335037 | 🔍 view |
| # | result | total | agent | in/out tok | flags | |
|---|---|---|---|---|---|---|
| 1 | FAIL | 1h00m | 58m38s | 9052694/213945 | 🔍 view |