Measured harness ledgerPublic result
Jev 1.13Dex Cube — 3 Move — Jev 1.13 Unreported
Complete the three-move Rubik's cube sequence D, F', U2 with regrasp, using two dexterous hands in MuJoCo.
Unreported reasoningHeadline result
- Workflow cost
- $0.04
- Wall-clock
- 153.9s wall-clock
- Processed tokens
- Not recorded
- Record state
- judge_verified_decision_loop_run_independently_replayed
Public summary
Jev 1.13 Unreported judge_verified_decision_loop_run_independently_replayed ledger: 153.9s wall-clock, Not recorded, and $0.04 Not an estimate: OpenRouter's own usage.cost field, reported per call and summed over the episode..
Run identity and stack
- Result ID: dex-cube-turn-mujoco-stage-2-three-moves-jev-1.13-decision-loop-openrouter-2026-09-20
- Technical model: Jev 1.13
- Provider: TypeSafe via OpenRouter
- Client: decision-loop executor (harness-authored), scaffold revision B2, DL_INTENT_GATING=0, POST https://openrouter.ai/api/alpha/decisions
- Stack: TypeSafe via OpenRouter
- Stack: decision-loop executor (harness-authored), scaffold revision B2, DL_INTENT_GATING=0, POST https://openrouter.ai/api/alpha/decisions
- Stack: Technical model/configuration: Jev 1.13
- Stack: MuJoCo dexterous-hand fixture
- Stack: Harness cube-turn stage-2 prompt
Primary artifact integrity
- Kind: open-loop-1khz-actuator-log
- Path: artifacts/dex-cube-turn-mujoco-stage-2-three-moves-jev-1.13-decision-loop-openrouter-2026-09-20/evidence/decision-loop/ctrl.npy
- SHA-256: ef4ee67ff675a3750a83e992eedfa36ce549cc3d447c1614770fd737e2bca675
Validation evidence
- Result: PASS
- Path: artifacts/dex-cube-turn-mujoco-stage-2-three-moves-jev-1.13-decision-loop-openrouter-2026-09-20/validation/judge-replay.public.json
- SHA-256: adcac5e693e024340a8a59bea77725a30fdb2ebb45bd7f70f93dd00079f18174
- Validator SHA-256: 329a7f94ec9d9a37edbb94b6fcad5a2e48e32aca160e93e683f5de2763f4ab34
Recorded caveats
- NOT COMPARABLE WITH THE CODING-AGENT COHORTS ON THIS TASK. Every other result here came from a coding agent with a shell, the fixture workspace, hours of wall clock and unlimited self-play against the simulator, submitting a controller it had already debugged. This is a decision-loop run: the model saw one structured observation at a time, answered two typed multiple-choice questions per control cycle (one intent, then the per-channel directions), and never wrote code, never ran the simulator, never saw an image and never read the judge. The executor that performed the increments is HARNESS-AUTHORED, not model-authored. Cycles, cost, wall clock and outcome mean different things in the two tracks and must never be put in one league table. cohort_eligible is false for exactly this reason. This is also ONE SEED, ONE TRIAL, not a success-rate estimate.
- ONE SEED, ONE TRIAL. This is a single episode, not a success-rate estimate, and it must not be quoted as one.
- The executor is HARNESS-AUTHORED and owns every physical primitive listed in benchmarks/tracks/decision-loop/README.md. What is measured here is whether a decision model can sequence those primitives from structured state - not grasping, planning or control skill in general.
- Adapter ceiling, measured with the scripted direction oracle on the same adapter, budget and frozen judge: FAIL - movesReached 1/3: the oracle turns D at t = 1.711 s and then stalls, because the loop has no TCP-translation channel. ONE MOVE OF THREE IS THE CEILING OF THIS ACTION SPACE.
- The replay clip is NOT committed; it is pinned by name, sha256, bytes, frames and duration in provenance/clips.public.json.
- api-archive.jsonl and model_calls.json are not committed - they carry the complete request/response stream and per-call provider generation ids - only their sha256 commitments are published, in provenance/source-receipt-hashes.json. The API key appears in none of them and was verified absent before this archive was assembled.
- The superseded revision-A episode is disclosed by hash and is NOT scored.
- provenance/orchestrator-results.md is the task project's own decision-loop section copied verbatim with absolute local paths replaced.
- Wall clock is dominated by API waiting, not compute, and is not a measure of model speed.
- evidence/decision-loop/run.json is committed EXACTLY as the executor wrote it, so its `final.submission` field still carries the operator's absolute workspace path - the same disclosure the claw self-check archive carries. It is a path, not a secret, and no other committed file in this archive contains one.
Visible evidence gaps
- a second episode on this task (every row in this track is a single trial)
- an LLM comparator through the identical loop (the scaffold supports one; none is registered here)
Public result only
This result keeps its public summary and evidence, but it does not currently have a matching Builder test with prompts, projects, Harness workflows or skills.