Versioned benchmark collection

Two-handed puzzle

Public ledger · prompt hash recorded · 6 measured runs across 1 target. Each entry is a single recorded attempt; repeat-run reliability is not established.

Two-handed puzzle public evidence
Two-handed puzzle public evidence
6Measured runs
1Frozen targets
6Model families
6Configurations
Collection scope

Recorded evidence, without a synthetic score.

Runs share the same frozen target and prompt within each test, with disclosed provider-specific stacks. Costs are recorded estimates as labelled in each ledger, not subscription invoices.

Targets

  • Claw Unlock

Model coverage

  • GPT-6 Astra · Max
  • GPT-6 Sol · Max
  • Grok 4.6 · xhigh
  • Grok 4.7 · xhigh
  • MiMo V2.6 Pro · Highest
  • Claude Opus 5.5 · Max

Evidence available

  • 6 runs on prompt 2fd1cb6ca345
  • Prompt SHA-256 2fd1cb6ca34572db43df2bb5d865f55fcb30756eddd9fa4dc203d2b9f4b74046
  • Exact prompt file path was not published

Still missing

  • No released Builder project, harness package, or skill download.
  • Exact prompt file path was not published with this test.
  • 3 related records are listed separately and are not attached to this prompt.
  • Repeat-run reliability evidence is not established.
Public receipts

6 measured run ledgers

Open any row for its recorded workflow cost, timing, token usage, stack disclosure, artifact integrity, and explicit evidence gaps.

01GPT-6 AstraMax reasoning · Claw Unlockjudge_pass_independently_replayed · PASS · Prompt version v1$14.36 Standard API-equivalent estimate from the Codex wrapper receipt, not a subscription invoice: this was a ChatGPT-subscription run, $0 was charged and Codex emits no cost field.recorded estimate53m 05s wall-clockEnd-to-end workflowOpen 02GPT-6 SolMax reasoning · Claw Unlockjudge_fail_independently_replayed · PASS · Prompt version v1$14.06 Standard API-equivalent estimate from the Codex wrapper receipt, not a subscription invoice: this was a ChatGPT-subscription run, $0 was charged and Codex emits no cost field.recorded estimate108m 35s wall-clockEnd-to-end workflowOpen 03Grok 4.6xhigh reasoning · Claw Unlockjudge_fail_independently_replayed · PASS · Prompt version v1$6.15 Provider-recorded usage estimate, not an itemized subscription cash chargerecorded estimate72m 45s wall-clockEnd-to-end workflowOpen 04Grok 4.7xhigh reasoning · Claw Unlockjudge_fail_independently_replayed · PASS · Prompt version v1$11.03 Provider-recorded usage estimate, not an itemized subscription cash chargerecorded estimate58m 38s wall-clockEnd-to-end workflowOpen 05MiMo V2.6 ProHighest reasoning · Claw Unlockjudge_fail_independently_replayed · pass · Prompt version v1$0.32 Provider-recorded usage estimate, not an itemized subscription cash chargerecorded estimate73m 25.6s wall-clockEnd-to-end workflowOpen 06Claude Opus 5.5Max reasoning · Claw Unlockjudge_fail_independently_replayed · PASS · Prompt version v1$17.39 recorded total_cost_usd from workspace FINAL.json (modelUsage.claude-opus-5-5, costBasis=list, Anthropic list price). Charged to the Claude subscription ($0 charged).recorded estimate93m 17s wall-clockEnd-to-end workflowOpen
Prompt provenance

Exact prompt receipts

A path is shown only when the published record includes the prompt hash that identifies it. Campaign evidence and projections keep the hash gap visible.

claw-unlock-geometry

SHA-256 2fd1cb6ca34572db43df2bb5d865f55fcb30756eddd9fa4dc203d2b9f4b74046

Exact prompt file path was not published.

Separate records

Related records with unknown prompt provenance

These published records stay separate from the prompt receipts above. Unknown provenance is why they are listed here.