← older: smoke__laguna-s-2.1__20260726-200500all runs · task boardnewer: smoke__gemma-4-12b__20260726-212728

smoke__laguna-s-2.1__20260726-201248

laguna-s-2.1 first light — smoke 4/4: openssl-selfsigned-cert (PASS) + BATCH ROLL-UP

Job 4 of four. MinimalPi, K=1, uncapped. This file carries the roll-up for the whole first-light batch.

openssl-selfsigned-cert — PASS, 5m27s total / 4m53s agent, 63223 in / 4870 out

Clean pass, no guard fires. The historical false-success poster child (fixed by preamble RULE 2) stayed fixed on this model.


Batch roll-up: laguna-s-2.1 smoke = 3/4

First benchmark run of laguna-s-2.1 (poolside 118B-A8B MoE, UD-Q4_K_S ~68.6 GB, partial offload with experts in system RAM, -c 262144, --reasoning-budget 2000). Harness: MinimalPi (baseline), K=1, no fast-fail caps. Four one-task Harbor jobs, llama-swap restarted before each.

task result total agent in/out tok 35b agent ratio
fix-git FAIL 4m18s 3m44s 76479/3363 18s 12×
regex-log PASS 22m16s 21m30s 225315/24778 (cut@20m)
nginx-request-logging PASS 7m40s 7m02s 90809/7396 15s 28×
openssl-selfsigned-cert PASS 5m27s 4m53s 63223/4870 13s 22×

Total wall clock ~40 min for 4 tasks.

Operational findings

1. The RAM ratchet did NOT reproduce — laguna is not the 122b. This was the main risk going in (laguna is the other ~45 GiB shmem-expert model, and the box started with only 10.4 GiB MemAvailable, so a 122b-style ratchet of ~59 GiB in 10–25 min would have OOM-killed the box within minutes). Measured across the full ~40 min batch, MemAvailable was flat: 10.4 → 10.1 → 10.1 → 10.2 → 10.2 GiB, swap untouched. Sampled every 30s throughout. The per-job llama-swap restarts were therefore insurance that turned out not to be needed — worth keeping for unattended runs until a longer session confirms this, but laguna does not need the 122b's one-task-per-job batching discipline.

2. laguna is 12–28× the 35b wall clock on short tasks — much slower than the 122b's 4–7×. Sustained decode ~17–19 tok/s (vs ~165 tok/s for the 35b at f16 KV), plus ~2–3× more output tokens per task. Consequences:

3. Wire path is clean. Tool calling, reasoning split, and thinking all behaved through the harness's exact path: qwen-named tools registered and used fluently (run_shell_command, read_file, write_file), reasoning arriving in reasoning_content via --reasoning-format deepseek, zero schema errors, zero unknown-tool errors, zero wire-format leaks across all four trials. The documented "empty content" gotcha never appeared — MAX_TOKENS=65536 is far above the ~3000 floor it needs. No guard fired in any trial (0 loop blocks, 0 write rejections, 0 bash timeouts, 0 recovery nudges), and no trial hit a length-stop.

The one failure

fix-git — a genuine near-miss, fully written up in smoke__laguna-s-2.1__20260726-193806/NOTES.md and COMMENTS.md. Short version: it hand-wrote its cherry-pick conflict resolution instead of restoring the file from the git object, and verified git status/git log (process) rather than file content (the graded criterion). The 35b makes the identical mistake and escapes it only by running cat -A and then git show <rev>:<path> > <path>.

Caveats

K=1 on every task — single-trial results, no variance estimate. Uncapped, so these timings are directly comparable to other uncapped runs only.

Run details

modelllama-local/laguna-s-2.1agentharnesses.minimal_pi:MinimalPithinkingonreasoning budgetdirect (server/none)* — see journal for the authoritative mechanismmaxTokens / contextWindow65536 / 196608agent timeout ×2.0trials1 of 1 — 1 pass · 0 failmean reward1.00tokens (job total)63,223 in / 4,870 outstarted / finished2026-07-26T20:12 / 2026-07-26T20:18wall clock5m27s

Tasks

openssl-selfsigned-cert — 1/1 passed

#resulttotalagentin/out tokflags
1PASS5m27s4m53s63223/4870
🔍 view