Versioned benchmark collection
MacBook Cinematic v1
Harness v1 · 5 measured runs across 1 target. Each entry is a single recorded attempt; repeat-run reliability is not established.
5Measured runs
1Frozen targets
5Model families
5Configurations
Collection scope
Recorded evidence, without a synthetic score.
Runs share the same frozen target and prompt within each test, with disclosed provider-specific stacks. Costs are recorded estimates as labelled in each ledger, not subscription invoices.
Targets
- MacBook-class cinematic ad scene
Model coverage
- Claude Fable 5 · Max
- GPT-5.6 Sol · xhigh
- Kimi K3 · Max
- Claude Opus 5 · Max
- Qwen3.8 Max Preview · Mandatory thinking enabled
Evidence available
- Five measured run ledgers
- Public recorded outputs
- Cost, token, and workflow timing
Still missing
- One reconciled Kimi API request
- Repeat-run reliability evidence
- Minimum blind-vote sample
Public receipts
5 measured run ledgers
Open any row for its recorded workflow cost, timing, token usage, stack disclosure, artifact integrity, and explicit evidence gaps.
01Claude Fable 5Max reasoning · MacBook-class cinematic ad scene$75.18 API-equivalent estimate, not a subscription invoicerecorded estimate1:01:04.8 wall-clockEnd-to-end workflowOpen 02GPT-5.6 Solxhigh reasoning · MacBook-class cinematic ad scene$7.67 API-equivalent estimate, not a subscription invoicerecorded estimate55:49.9 wall-clockEnd-to-end workflowOpen 03Kimi K3Max reasoning · MacBook-class cinematic ad scene≥$10.85 API-equivalent lower bound over paired usage records, not an itemized subscription cash charge (lower bound)recorded lower bound1:26:58.2 wall-clockEnd-to-end workflowOpen 04Claude Opus 5Max reasoning · MacBook-class cinematic ad scene$27.40 API-equivalent estimate, not a subscription invoicerecorded estimate1h 07m 02.5s wall-clockEnd-to-end workflowOpen 05Qwen3.8 Max PreviewMandatory thinking enabled reasoning · MacBook-class cinematic ad scene$29.27 Qualified third-party NanoGPT API-list-price scenario; not an Alibaba Token Plan cash chargerecorded estimate7h 00m 56.4s wall-clockEnd-to-end workflowOpen