← older: fast2__qwen3.6-35b-a3b__20260710-192053all runs · task boardnewer: fast__qwen3.6-35b-a3b__20260710-213727

medic__qwen3.6-35b-a3b__20260710-201401

medic__qwen3.6-35b-a3b__20260710-201401 — medic recovery over fast2 (P0)

RULE-RELAXED recoverability axis — NOT a baseline/leaderboard number. The medic is deliberately told the verifier failed and shown the exact failing-check output. Baseline scoring stays the standard number; this is a separate column.

Phase 1 (baseline): runs/fast2__qwen3.6-35b-a3b__20260710-192053 (MinimalPi, MEDIC_CAPTURE=on, fast2 set default caps). 1/6 pass (fix-ocaml-gc), 5 fail. Phase 2 (this run, MedicPi, signal=full log_access=dump workspace=restore, per-session cap default=900): the 5 failed workspaces were restored in place with the failing pytest output injected. All 5 restores confirmed in the log, incl. reshard-c4-data at 752M (large-artifact upload+extract works).

Recoverability verdict: 3/5 recovered in one round (60%)

task baseline medic verdict
git-multibranch fail pass RECOVERED (1 passed, 6s)
mailman fail pass RECOVERED (3 passed)
reshard-c4-data fail (cut@5m in phase 1) pass RECOVERED (1 passed, 66s)
financial-document-processor fail fail inconclusive — cut@15m by the 900s medic cap (exit 124), a genuinely long task (14m49s in phase 1); may recover with a larger cap
headless-terminal fail fail still-fails (stopped on its own, 3m12s)

Suite line: baseline 1/6 · +1 nudge 4/6 · recoverability 3/5 = 60% (and the one clean not-recovered is headless-terminal; financial-document-processor is cap-limited, not a real negative — so the true ceiling is 3–4/5).

All three recoveries are genuine Harbor-verifier passes (reward=1.0), not false-success: real pytest green (1 passed/3 passed).

What this says

For qwen 35b on fast2, a majority of failures are within one debugging round once the model is handed the concrete error and its own broken code — exactly the "how recoverable is this failure" signal the axis is built to produce. It is a much stronger result than the single cancel-async-tasks case (runs/medic__…190552, still-fails/near-miss): the difference is task-dependent, which is the interesting variable.

Caveats / honesty

💬 5 analyst comments inline below (from runs/medic__qwen3.6-35b-a3b__20260710-201401/COMMENTS.md).

Run details

modelllama-local/qwen3.6-35b-a3bagentharnesses.medic_pi:MedicPithinkingonreasoning budgetdirect (server/none)* — see journal for the authoritative mechanismmaxTokens / contextWindow65536 / 196608agent timeout ×2.0trials5 of 5 — 3 pass · 2 failmean reward0.60tokens (job total)23,148,286 in / 224,024 outstarted / finished2026-07-10T20:14 / 2026-07-10T20:58wall clock44m21s

Tasks

financial-document-processor — 0/1 passed

💬 analyst comment

Medic still shows fail, but it was CUT at the 900s medic cap (fast-timeout exit 124), a genuinely long task (14m49s baseline agent). Inconclusive, not a clean negative — a larger cap might recover it.

#resulttotalagentin/out tokflags
1FAIL15m47s15m00s5711647/100892
fast-timeout cut at 15mlong reasoning (19,878 chars) ×3loop-guard blocked a repeated call ×2
🔍 view

git-multibranch — 1/1 passed

💬 analyst comment

Medic RECOVERED (baseline fail → pass, 1 passed in 6s). Restored workspace + failing-check output was enough for a one-round fix.

#resulttotalagentin/out tokflags
1PASS6m57s6m10s3188563/40991
a bash command timed out
🔍 view

headless-terminal — 0/1 passed

💬 analyst comment

The one clean not-recovered: the medic stopped on its own (3m12s) and did not fix the failure. A real still-fails datapoint.

#resulttotalagentin/out tokflags
1FAIL4m00s3m12s1353340/17567
🔍 view

mailman — 1/1 passed

💬 analyst comment

Medic RECOVERED (baseline fail → pass, 3 passed). 10m/11.1M-input session — the MoE churned but landed a genuine pass.

#resulttotalagentin/out tokflags
1PASS11m17s10m12s11121426/50411
🔍 view

reshard-c4-data — 1/1 passed

💬 analyst comment

Medic RECOVERED (baseline fail → pass, 1 passed in 66s) — despite a 752M restore (input data + the base agent's output shards) and a phase-1 trial that was cut at 5m. Proves the large-artifact restore path works end to end.

#resulttotalagentin/out tokflags
1PASS6m18s4m14s1773310/14163
🔍 view