Versioned benchmark collection

Robot pick-and-place · decision loop

Public ledger · prompt hash recorded · 9 measured runs across 1 target. Each entry is a single recorded attempt; repeat-run reliability is not established.

No published still for Robot pick-and-place · decision loop
9Measured runs
1Frozen targets
5Model families
5Configurations
Collection scope

Recorded evidence, without a synthetic score.

Runs share the same frozen target and prompt within each test, with disclosed provider-specific stacks. Costs are recorded estimates as labelled in each ledger, not subscription invoices.

Targets

  • Apple Carry

Model coverage

  • GPT-5.6 Luna · Low
  • Jev 1.13 · Unreported
  • Laya 421M · Unreported
  • SemIf + Qwen3-0.6B · Unreported
  • SemIf + Qwen3.5-4B · Unreported

Evidence available

  • 9 runs on prompt 699ebc2b02b4
  • Prompt SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
  • Exact prompt file path was not published

Still missing

  • No released Builder project, harness package, or skill download.
  • Exact prompt file path was not published with this test.
  • Repeat-run reliability evidence is not established.
Public receipts

9 measured run ledgers

Open any row for its recorded workflow cost, timing, token usage, stack disclosure, artifact integrity, and explicit evidence gaps.

01GPT-5.6 LunaLow reasoning · Apple Carryjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1$9.59 Not an invoice: $0 charged. API-equivalent is at the harness on-record Luna rates.recorded estimateNot recordedEnd-to-end workflowOpen 02Jev 1.13Unreported reasoning · Apple Carryjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1$0.24 Not an estimate: OpenRouter's own usage.cost field, reported per call and summed over every call of every episode.recorded estimateNot recordedEnd-to-end workflowOpen 03Laya 421MUnreported reasoning · Apple Carryjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1$0.00 Not an estimate: $0. Local compute.recorded estimateNot recordedEnd-to-end workflowOpen 04SemIf + Qwen3-0.6BUnreported reasoning · Apple Carryoperator_stopped_incomplete_sweep · Prompt version v1$0.00 local inference, $0recorded estimateNot recordedEnd-to-end workflowOpen 05SemIf + Qwen3.5-4BUnreported reasoning · Apple Carryjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1$0.00 Pod invoice $2.40, not an OpenRouter charge.recorded estimateNot recordedEnd-to-end workflowOpen 06GPT-5.6 LunaLow reasoning · Apple Carryjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1$16.09 Recorded provider costrecorded estimateNot recordedEnd-to-end workflowOpen 07Jev 1.13Unreported reasoning · Apple Carryjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1$0.35 Not an estimate: OpenRouter's own usage.cost field, reported per call and summed over every call of every episode.recorded estimateNot recordedEnd-to-end workflowOpen 08Laya 421MUnreported reasoning · Apple Carryjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1$0.00 Recorded provider costrecorded estimateNot recordedEnd-to-end workflowOpen 09SemIf + Qwen3.5-4BUnreported reasoning · Apple Carryjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1$0.00 Recorded provider costrecorded estimateNot recordedEnd-to-end workflowOpen
Prompt provenance

Exact prompt receipts

A path is shown only when the published record includes the prompt hash that identifies it. Campaign evidence and projections keep the hash gap visible.

apple-carry

SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b

Exact prompt file path was not published.

Separate records

Related records with unknown prompt provenance

These published records stay separate from the prompt receipts above. Unknown provenance is why they are listed here.

No separate unattached records are published for this collection.