Versioned benchmark collection

Shader Frontier v1

Harness v1 · 17 measured runs across 2 targets. Each entry is a single recorded attempt; repeat-run reliability is not established.

Infinite cathedral shader output in the Shader Frontier v1 collection
Infinite cathedral shader output in the Shader Frontier v1 collection
17Measured runs
2Frozen targets
6Model families
9Configurations
Collection scope

Recorded evidence, without a synthetic score.

Runs share the same frozen target and prompt within each test, with disclosed provider-specific stacks. Costs are recorded estimates as labelled in each ledger, not subscription invoices.

Targets

  • Neo-Gothic Storm City
  • Stained Glass Cathedral Shader

Model coverage

  • GPT-5.6 Sol · Ultra
  • Claude Fable 5 · Medium
  • Claude Fable 5 · Low
  • GPT-5.6 Luna · xhigh
  • GPT-5.6 Terra · Ultra
  • Claude Fable 5 · Max
  • GPT-5.6 Sol · xhigh
  • Kimi K3 · Max
  • Qwen3.8 Max Preview · Unreported

Evidence available

  • Fifteen measured run ledgers
  • Shader artifacts with SHA-256
  • Cost, token, and workflow timing

Still missing

  • Initial and optimized local FPS
  • RTX Pro 6000 final-capture metadata
  • Minimum blind-vote sample
Public receipts

17 measured run ledgers

Open any row for its recorded workflow cost, timing, token usage, stack disclosure, artifact integrity, and explicit evidence gaps.

01GPT-5.6 SolUltra reasoning · Neo-Gothic Storm City$2.84 estimated API-equivalent costrecorded estimate22:10.9 wall-clockEnd-to-end workflowOpen 02Claude Fable 5Medium reasoning · Neo-Gothic Storm City$9.09 estimated API costrecorded estimate8:15 wall-clockEnd-to-end workflowOpen 03Claude Fable 5Low reasoning · Neo-Gothic Storm CityNot recordedrecorded estimateNot recordedEnd-to-end workflowOpen 04Claude Fable 5Medium reasoning · Stained Glass Cathedral Shader$19.17 estimated API costrecorded estimate15:38.1 wall-clockEnd-to-end workflowOpen 05GPT-5.6 Lunaxhigh reasoning · Stained Glass Cathedral Shader$0.21 estimated API-equivalent costrecorded estimate9:18.2 wall-clockEnd-to-end workflowOpen 06GPT-5.6 SolUltra reasoning · Stained Glass Cathedral Shader$5.61 estimated API-equivalent costrecorded estimate38:22.4 wall-clockEnd-to-end workflowOpen 07GPT-5.6 TerraUltra reasoning · Stained Glass Cathedral Shader$0.55 estimated API-equivalent costrecorded estimate20:39.8 wall-clockEnd-to-end workflowOpen 08GPT-5.6 Lunaxhigh reasoning · Neo-Gothic Storm City$0.21 estimated API-equivalent costrecorded estimate8:46.5 wall-clockEnd-to-end workflowOpen 09GPT-5.6 TerraUltra reasoning · Neo-Gothic Storm City$3.27 estimated API-equivalent costrecorded estimate16:35.1 wall-clockEnd-to-end workflowOpen 10Claude Fable 5Max reasoning · Stained Glass Cathedral Shader$43.85 estimated API-equivalent costrecorded estimate31:13.8 wall-clockEnd-to-end workflowOpen 11GPT-5.6 Solxhigh reasoning · Stained Glass Cathedral Shader$4.10 estimated API-equivalent costrecorded estimate24:19.8 wall-clockEnd-to-end workflowOpen 12Kimi K3Max reasoning · Stained Glass Cathedral Shader$0.92 estimated API-equivalent costrecorded estimate21:54.1 wall-clockEnd-to-end workflowOpen 13Qwen3.8 Max PreviewUnreported reasoning · Stained Glass Cathedral Shader$5.32 estimated API-equivalent costrecorded estimate25m 9.2s wall-clockEnd-to-end workflowOpen 14Claude Fable 5Max reasoning · Neo-Gothic Storm City$11.39 estimated API-equivalent costrecorded estimate28:48 wall-clockEnd-to-end workflowOpen 15GPT-5.6 Solxhigh reasoning · Neo-Gothic Storm City$1.96 estimated API-equivalent costrecorded estimate8:49.5 wall-clockEnd-to-end workflowOpen 16Kimi K3Max reasoning · Neo-Gothic Storm City$2.30 estimated API-equivalent costrecorded estimate38:29.074 wall-clockEnd-to-end workflowOpen 17Qwen3.8 Max PreviewUnreported reasoning · Neo-Gothic Storm City$0.28 estimated API-equivalent costrecorded estimate7m 56.8s wall-clockEnd-to-end workflowOpen