← older: smoke__qwen3.6-35b-a3b__20260704-152728all runs · task boardnewer: smoke__qwen3.6-35b-a3b__20260704-192605

smoke__qwen3.6-35b-a3b__20260704-180910

Hysteresis smoke — guard correct in 5/5; both fails are the SAME artifact: reasoning-budget force-close → plain-text thinking continuation → 32k runaway

What was run

regex-log × 5, COMPACT_AT_TOKENS=15000, first run with frontier hysteresis (stable stub set between calls, batched advances) + live ratio calibration.

Guard verdict: working as designed

The two failures — smoking-gun evidence on the budget force-close

Both are length-stop plain-text runaways (B1), and both show the same mechanism:

So: the budget force-close doesn't just cause degenerate stops (the > char, the user leak) — it causes plain-text thinking-continuation runaways, and tonight it cost 2/5 trials on a task with a ~90% historical pass rate. THINK sizes at the cut: 9–13k chars ≈ 2.9–3.8k tokens, right at the 4000 budget. This mechanistically links two planned experiments: 1. Reasoning-budget sweep / --reasoning-budget-message tuning (server-side) — attack the trigger; 2. DRY sampler — attack the symptom (the loop itself).

Cache A/B at limit 15000: neutral, as expected in hindsight

Hit rate 65.4% (hysteresis) vs 73.1% (per-call pruning, run …150817) — a wash, confounded by the two looper trials (43/46-request trajectories, 60k+ char text blocks). The structural reason: at limit 15000 the limit−target slack is only ~3.7k real-equivalent tokens ≈ 1–2 turns, so the frontier advances almost every few calls anyway. At the production limit (200000, slack 50k ≈ 15–30 turns per advance) the batching actually pays. Decisive measurement = rerunning make-mips-interpreter at stock settings (baseline: 62.4% hit, 79 cache breaks, ~23 min re-prefill).

Server note: no --cache-reuse in the llama-swap config — strict prefix caching, so the stable-prefix property is the only cache lever available.

Next

  1. make smoke MODELS=qwen3.6-35b-a3b SMOKE_TASKS=make-mips-interpreter (~1h) — the real cache measurement: expect single-digit pr: (vs 79) and hit rate back toward ~90%.
  2. Reasoning-budget sweep 2000/4000/8000 + budget-message phrasing — now the top score lever (NOT during a live run; llama-swap hot-reloads).
  3. DRY sampler A/B (polyglot-rust-c should improve, circuit-fibsqrt unchanged).

Run details

modelllama-local/qwen3.6-35b-a3bagentharnesses.minimal_pi:MinimalPithinkingonreasoning budgetdirect (server/none)* — see journal for the authoritative mechanismmaxTokens / contextWindow32768 / 229376agent timeout ×2.0trials5 of 5 — 3 pass · 2 failmean reward0.60tokens (job total)1,319,499 in / 315,923 outstarted / finished2026-07-04T18:09 / 2026-07-04T18:47wall clock38m37s

Tasks

regex-log — 3/5 passed

#resulttotalagentin/out tokflags
1PASS3m46s2m50s210911/26508
🔍 view
2FAIL12m06s11m10s443461/107290
generation hit the output-token limit (truncated / runaway)long reasoning (12,709 chars) ×3
🔍 view
3PASS11m00s10m00s470698/88390
long reasoning (12,072 chars) ×5
🔍 view
4PASS7m33s6m38s192672/61735
🔍 view
5FAIL4m10s3m12s1757/32000
claimed success but the verifier did NOT pass (heuristic)generation hit the output-token limit (truncated / runaway)
🔍 view