Versioned benchmark collection
Space Flight v1
Harness v1 · 8 measured runs across 1 target. Each entry is a single recorded attempt; repeat-run reliability is not established.
8Measured runs
1Frozen targets
6Model families
7Configurations
Collection scope
Recorded evidence, without a synthetic score.
Runs share the same frozen target and prompt within each test, with disclosed provider-specific stacks. Costs are recorded estimates as labelled in each ledger, not subscription invoices.
Targets
- Space Flight Game
Model coverage
- GPT-5.6 Terra · Ultra
- GPT-5.6 Sol · Ultra
- Claude Fable 5 · Medium
- GPT-5.6 Luna · xhigh
- Claude Fable 5 · Max
- Kimi K3 · Max
- Qwen3.8 Max Preview · Unreported
Evidence available
- Six measured run ledgers
- Public browser builds
- Cost, token, and workflow timing
Still missing
- Browser/hardware environment
- Local FPS
- Final capture metadata
- Minimum blind-vote sample
Public receipts
8 measured run ledgers
Open any row for its recorded workflow cost, timing, token usage, stack disclosure, artifact integrity, and explicit evidence gaps.
01GPT-5.6 TerraUltra reasoning · Space Flight Game$1.44 estimated API-equivalent costrecorded estimate16:51.4 wall-clockEnd-to-end workflowOpen 02GPT-5.6 SolUltra reasoning · Space Flight Game$17.94 estimated API-equivalent costrecorded estimate37:44.2 wall-clockEnd-to-end workflowOpen 03Claude Fable 5Medium reasoning · Space Flight Game$22.85 estimated API-equivalent costrecorded estimate18:37.7 wall-clockEnd-to-end workflowOpen 04GPT-5.6 Lunaxhigh reasoning · Space Flight Game$0.33 estimated API-equivalent costrecorded estimate10:55.9 wall-clockEnd-to-end workflowOpen 05Claude Fable 5Max reasoning · Space Flight Game$151.55 estimated API-equivalent costrecorded estimate1:05:19.2 wall-clockEnd-to-end workflowOpen 06Kimi K3Max reasoning · Space Flight Game$3.25 estimated API-equivalent costrecorded estimate1:04:11 wall-clockEnd-to-end workflowOpen 07Qwen3.8 Max PreviewUnreported reasoning · Space Flight Game$45.89 estimated API-equivalent costrecorded estimate2h 4m 17.3s wall-clockEnd-to-end workflowOpen 08Qwen3.8 Max PreviewUnreported reasoning · Space Flight Game$6.95 estimated API-equivalent costrecorded estimate38m 43.2s wall-clockEnd-to-end workflowOpen