Measured harness ledgerPublic result
Jev 1.13

Dex Cube Turn — Jev 1.13 Unreported

Turn one face of a Rubik's cube a quarter turn by finger contact with two dexterous hands in MuJoCo.

Unreported reasoningHeadline result
Workflow cost
$0.02
Wall-clock
82.7s wall-clock
Processed tokens
Not recorded
Record state
judge_verified_decision_loop_run_independently_replayed
Public summary

Jev 1.13 Unreported judge_verified_decision_loop_run_independently_replayed ledger: 82.7s wall-clock, Not recorded, and $0.02 Not an estimate: OpenRouter's own usage.cost field, reported per call and summed over the episode..

Run identity and stack
  • Result ID: dex-cube-turn-mujoco-jev-1.13-decision-loop-openrouter-2026-09-20
  • Technical model: Jev 1.13
  • Provider: TypeSafe via OpenRouter
  • Client: decision-loop executor (harness-authored), scaffold revision B2, DL_INTENT_GATING=0, POST https://openrouter.ai/api/alpha/decisions
  • Stack: TypeSafe via OpenRouter
  • Stack: decision-loop executor (harness-authored), scaffold revision B2, DL_INTENT_GATING=0, POST https://openrouter.ai/api/alpha/decisions
  • Stack: Technical model/configuration: Jev 1.13
  • Stack: MuJoCo dexterous-hand fixture
  • Stack: Harness cube-turn prompt
Primary artifact integrity
  • Kind: open-loop-1khz-actuator-log
  • Path: artifacts/dex-cube-turn-mujoco-jev-1.13-decision-loop-openrouter-2026-09-20/evidence/decision-loop/ctrl.npy
  • SHA-256: 0ac8779ba327fe14878e6604690eabd71f6d1a311315b171eae9e6e6bbd7a63c
Validation evidence
  • Result: PASS
  • Path: artifacts/dex-cube-turn-mujoco-jev-1.13-decision-loop-openrouter-2026-09-20/validation/judge-replay.public.json
  • SHA-256: 994909f0eed1567c4c5218dddf931f6d47c9e7db4ebbc0066608fb892208f6d3
  • Validator SHA-256: 5f7750274d345db503f3320931fedc68d0d3d01573dd5a88052910b9213d7203
Recorded caveats
  • NOT COMPARABLE WITH THE CODING-AGENT COHORTS ON THIS TASK. Every other result here came from a coding agent with a shell, the fixture workspace, hours of wall clock and unlimited self-play against the simulator, submitting a controller it had already debugged. This is a decision-loop run: the model saw one structured observation at a time, answered two typed multiple-choice questions per control cycle (one intent, then the per-channel directions), and never wrote code, never ran the simulator, never saw an image and never read the judge. The executor that performed the increments is HARNESS-AUTHORED, not model-authored. Cycles, cost, wall clock and outcome mean different things in the two tracks and must never be put in one league table. cohort_eligible is false for exactly this reason. This is also ONE SEED, ONE TRIAL, not a success-rate estimate.
  • ONE SEED, ONE TRIAL. This is a single episode, not a success-rate estimate, and it must not be quoted as one.
  • The executor is HARNESS-AUTHORED and owns every physical primitive listed in benchmarks/tracks/decision-loop/README.md. What is measured here is whether a decision model can sequence those primitives from structured state - not grasping, planning or control skill in general.
  • Adapter ceiling, measured with the scripted direction oracle on the same adapter, budget and frozen judge: PASS in 23 of 120 cycles (46 calls, solvedAt 1.70 s, 4 supporting pads) - the task is solvable in this action space.
  • The replay clip is NOT committed; it is pinned by name, sha256, bytes, frames and duration in provenance/clips.public.json.
  • api-archive.jsonl and model_calls.json are not committed - they carry the complete request/response stream and per-call provider generation ids - only their sha256 commitments are published, in provenance/source-receipt-hashes.json. The API key appears in none of them and was verified absent before this archive was assembled.
  • The superseded revision-A episode is disclosed by hash and is NOT scored.
  • provenance/orchestrator-results.md is the task project's own decision-loop section copied verbatim with absolute local paths replaced.
  • Wall clock is dominated by API waiting, not compute, and is not a measure of model speed.
  • evidence/decision-loop/run.json is committed EXACTLY as the executor wrote it, so its `final.submission` field still carries the operator's absolute workspace path - the same disclosure the claw self-check archive carries. It is a path, not a secret, and no other committed file in this archive contains one.
Visible evidence gaps
  • a second episode on this task (every row in this track is a single trial)
  • an LLM comparator through the identical loop (the scaffold supports one; none is registered here)
Public result only

This result keeps its public summary and evidence, but it does not currently have a matching Builder test with prompts, projects, Harness workflows or skills.

RemakeBenchResearch console