Benchmark family

Robot pick-and-place

Robot pick-and-place tests for the apple-carry task. Unaided runs, the decision loop, and the Astra planner plus Jev workflow keep their own records. Apple stem is a separate family.

Each stage, prompt version, and workflow stays in its own section, with that section's prompt receipt and status.

← All benchmarks

3Variants

15Attached runs

2Related records

0Released material sets

Unaided

1 variant keeps its own prompt receipt and status.

Robot pick-and-place

Public evidence · prompt hash recorded

5 runs on prompt 699ebc2b02b4

Task apple-carry

SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b

Exact prompt file path was not published.

Published Date unreported

No released Builder download is published for this variant.

Open this variant record

Material gaps

No released Builder project, harness package, or skill download.
Exact prompt file path was not published with this test.
2 related records are listed separately and are not attached to this prompt.
Repeat-run reliability evidence is not established.

Attached runs

GPT-6 Astrajudge_pass_independently_replayed · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
GPT-6 Soljudge_pass_independently_replayed · PASS · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
Grok 4.7judge_pass_independently_replayed · PASS · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
MiMo V2.6 Projudge_pass_independently_replayed · pass · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
Claude Opus 5.5judge_pass_independently_replayed · PASS · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b

Separate records

GPT-6.1 Soljudge_pass_independently_replayed · PASS · Prompt hash unavailablePrompt version was not published.Prompt hash was not published for this record.This Launch 006 record is outside the synced harness expansion, so its prompt hash is not available and it is not attached to the prompt SHA.
Claude Sonnet 5.5judge_pass_independently_replayed · PASS · Prompt hash unavailablePrompt version was not published.Prompt hash was not published for this record.This Launch 006 record is outside the synced harness expansion, so its prompt hash is not available and it is not attached to the prompt SHA.

Decision loop

1 variant keeps its own prompt receipt and status.

Robot pick-and-place · decision loop

Decision loop · public evidence

9 runs on prompt 699ebc2b02b4

Task apple-carry

SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b

Exact prompt file path was not published.

Published Date unreported

No released Builder download is published for this variant.

Open this variant record

Material gaps

No released Builder project, harness package, or skill download.
Exact prompt file path was not published with this test.
Repeat-run reliability evidence is not established.

Attached runs

GPT-5.6 Lunajudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
Jev 1.13judge_verified_decision_loop_sweep_independently_replayed · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
Laya 421Mjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
SemIf + Qwen3-0.6Boperator_stopped_incomplete_sweep · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
SemIf + Qwen3.5-4Bjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
GPT-5.6 Lunajudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
Jev 1.13judge_verified_decision_loop_sweep_independently_replayed · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
Laya 421Mjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b
SemIf + Qwen3.5-4Bjudge_verified_decision_loop_sweep_independently_replayed · Prompt version v1Prompt version v1SHA-256 699ebc2b02b4dc3f8e22b498948bd2af7ad7e94b10b288f7629589fe875e092b

Separate records

No separate unattached record was published for this variant.

Astra planner plus Jev

1 variant keeps its own prompt receipt and status.

Apple carry, Astra planner plus Jev

Supplemental · planner plus Jev

1 run without a prompt hash

Task apple-carry

Prompt hash was not published.

Exact prompt file path was not published.

Published Date unreported

No released Builder download is published for this variant.

Open this variant record

Material gaps

No released Builder project, harness package, or skill download.
Prompt hash was not recorded on these ledgers.
Exact prompt file path was not published with this test.
Repeat-run reliability evidence is not established.
This supplemental round is only the Astra planner plus Jev workflow.

Attached runs

GPT-6 Astra (low) planner + Jev 1.13 actorastra_planner_jev · judge_pass_independently_replayed · Prompt version unreported · Prompt hash unavailablePrompt version unreportedThis attached run has no separate prompt hash.

Separate records

No separate unattached record was published for this variant.