← older: suite__qwen3.6-35b-a3b__20260720-025830all runs · task boardnewer: suite__qwen3.6-35b-a3b__20260724-160500

resource__qwen3.6-35b-a3b__20260721-194555

Resource-lifted arm — 7 env/CPU-bound tasks at 24 CPU / 32 GB

Purpose: test whether the 7 tasks that ERR'd on the terminal-bench per-task resource declarations (cpus=1–4, memory=2–4G) in suite__20260720 were blocked by the cap or by capability. New CPU_OVERRIDE knob (--override-cpus) + existing MEM_OVERRIDE_MB lifted to 24 CPU / 32 GB for every task. MinimalPi, 35b, K=1, uncapped agent timeout (declared × 2.0). NON-STANDARD arm: override_cpus + override_memory_mb are recorded in config.json; Harbor's leaderboard static-validation rejects both, so this is NOT leaderboard-comparable and is kept off the board (BOARD_SET_EXCLUDE).

RESULT: 3/7 PASS (mean 0.43). Elapsed 4h25m.

task before (1c / 2–4G) after (24c / 32G)
caffe-cifar-10 ERR timeout @40m PASS @17m
mcmc-sampling-stan ERR timeout @60m PASS @11m
qemu-alpine-ssh ERR died @2m PASS @16m
install-windows-3.11 ERR OOM (137) @12m FAIL @5m (2/4 tests)
make-doom-for-mips ERR timeout @30m ERR timeout @30m
train-fasttext ERR timeout @2h ERR timeout @2h
extract-moves-from-video ERR timeout @60m FAIL @56m

Applied to the suite that is 40 → 43/89 (48.3%).

Interpretation

Bottom line: the lift cleanly separated "blocked by the cap" (3, fixable, +3) from "the cap was never the problem" (4: capability / hard-reasoning / long-compute / wrong-output). Resources remove walls; they don't solve tasks.

Run details

modelllama-local/qwen3.6-35b-a3bagentharnesses.minimal_pi:MinimalPithinkingonreasoning budgetdirect (server/none)* — see journal for the authoritative mechanismmaxTokens / contextWindow65536 / 196608agent timeout ×2.0trials7 of 7 — 3 pass · 2 fail · 2 erroredmean reward0.43tokens (job total)47,487,706 in / 333,058 outstarted / finished2026-07-21T19:45 / 2026-07-22T00:11wall clock4h25m

Errored trials: AgentTimeoutError (make-doom-for-mips, train-fasttext)

Tasks

caffe-cifar-10 — 1/1 passed

#resulttotalagentin/out tokflags
1PASS18m01s16m39s2848318/20734
a bash command timed out ×2
🔍 view

extract-moves-from-video — 0/1 passed

#resulttotalagentin/out tokflags
1FAIL57m02s56m19s3077050/89421
claimed success but the verifier did NOT pass (heuristic)a bash command timed outlong reasoning (25,752 chars) ×6
🔍 view

install-windows-3.11 — 0/1 passed

#resulttotalagentin/out tokflags
1FAIL6m01s5m07s1353801/27110
claimed success but the verifier did NOT pass (heuristic)
🔍 view

make-doom-for-mips — 0/1 passed

#resulttotalagentin/out tokflags
1ERR31m08s30m00s24243523/99417
trial errored: AgentTimeoutError
🔍 view

mcmc-sampling-stan — 1/1 passed

#resulttotalagentin/out tokflags
1PASS16m00s10m51s95928/2921
🔍 view

qemu-alpine-ssh — 1/1 passed

#resulttotalagentin/out tokflags
1PASS16m30s15m56s1282579/24377
a bash command timed out ×5
🔍 view

train-fasttext — 0/1 passed

#resulttotalagentin/out tokflags
1ERR2h00m2h00m14586507/69078
trial errored: AgentTimeoutErrora bash command timed outlong reasoning (23,956 chars) ×2
🔍 view