Measured harness ledgerPublic result
Jev 1.13

Apple Stem — Jev 1.13 Unreported

Pinch an apple by the stem and lift it with a Wuji hand on an FR3 arm in SuperDex, without contacting the apple body.

Unreported reasoningHeadline result
Workflow cost
$0.01
Wall-clock
63.0s wall-clock
Processed tokens
Not recorded
Record state
judge_verified_decision_loop_run_independently_replayed
Public summary

Jev 1.13 Unreported judge_verified_decision_loop_run_independently_replayed ledger: 63.0s wall-clock, Not recorded, and $0.01 Not an estimate: OpenRouter's own usage.cost field, reported per call and summed over the episode..

Run identity and stack
  • Result ID: dex-apple-stem-superdex-jev-1.13-decision-loop-openrouter-2026-09-20
  • Technical model: Jev 1.13
  • Provider: TypeSafe via OpenRouter
  • Client: decision-loop executor (harness-authored), scaffold revision B2, DL_INTENT_GATING=0, POST https://openrouter.ai/api/alpha/decisions
  • Stack: TypeSafe via OpenRouter
  • Stack: decision-loop executor (harness-authored), scaffold revision B2, DL_INTENT_GATING=0, POST https://openrouter.ai/api/alpha/decisions
  • Stack: Technical model/configuration: Jev 1.13
  • Stack: SuperDex fingertip fixture
  • Stack: Harness apple-stem prompt
Primary artifact integrity
  • Kind: open-loop-200hz-joint-target-log
  • Path: artifacts/dex-apple-stem-superdex-jev-1.13-decision-loop-openrouter-2026-09-20/evidence/decision-loop/ctrl.npy
  • SHA-256: 3ab3b401a7c3b797ed52f6e83a86c1f1b5f27a4c7d285d1ee00b578fb0465d7e
Validation evidence
  • Result: PASS
  • Path: artifacts/dex-apple-stem-superdex-jev-1.13-decision-loop-openrouter-2026-09-20/validation/judge-replay.public.json
  • SHA-256: 7859c8a856258b80c5b8d7723a3e8696142b991977cb8bc9ce45dbc3d360ffbc
  • Validator SHA-256: c735d44ca72534f8058a7e1061ccf775f6e9f180cef26200d97a402f3de7403e
Recorded caveats
  • NOT COMPARABLE WITH THE CODING-AGENT COHORTS ON THIS TASK. Every other result here came from a coding agent with a shell, the fixture workspace, hours of wall clock and unlimited self-play against the simulator, submitting a controller it had already debugged. This is a decision-loop run: the model saw one structured observation at a time, answered two typed multiple-choice questions per control cycle (one intent, then the per-channel directions), and never wrote code, never ran the simulator, never saw an image and never read the judge. The executor that performed the increments is HARNESS-AUTHORED, not model-authored. Cycles, cost, wall clock and outcome mean different things in the two tracks and must never be put in one league table. cohort_eligible is false for exactly this reason. This is also ONE SEED, ONE TRIAL, not a success-rate estimate.
  • ONE SEED, ONE TRIAL. This is a single episode, not a success-rate estimate, and it must not be quoted as one.
  • The executor is HARNESS-AUTHORED and owns every physical primitive listed in benchmarks/tracks/decision-loop/README.md. What is measured here is whether a decision model can sequence those primitives from structured state - not grasping, planning or control skill in general.
  • Adapter ceiling, measured with the scripted direction oracle on the same adapter, budget and frozen judge: PASS stage 3 in 106 of 130 cycles (2 345 steps, lifted at 9.54 s to 51.6 mm, pads on the stem only, no body contact) - the task is solvable in this action space.
  • The replay clip is NOT committed; it is pinned by name, sha256, bytes, frames and duration in provenance/clips.public.json.
  • api-archive.jsonl and model_calls.json are not committed - they carry the complete request/response stream and per-call provider generation ids - only their sha256 commitments are published, in provenance/source-receipt-hashes.json. The API key appears in none of them and was verified absent before this archive was assembled.
  • The superseded revision-A episode is disclosed by hash and is NOT scored.
  • provenance/orchestrator-results.md is the task project's own decision-loop section copied verbatim with absolute local paths replaced.
  • Wall clock is dominated by API waiting, not compute, and is not a measure of model speed.
  • evidence/decision-loop/run.json is committed EXACTLY as the executor wrote it, so its `final.submission` field still carries the operator's absolute workspace path - the same disclosure the claw self-check archive carries. It is a path, not a secret, and no other committed file in this archive contains one.
Visible evidence gaps
  • a second episode on this task (every row in this track is a single trial)
  • an LLM comparator through the identical loop (the scaffold supports one; none is registered here)
Public result only

This result keeps its public summary and evidence, but it does not currently have a matching Builder test with prompts, projects, Harness workflows or skills.

RemakeBenchResearch console