BuilderBuilder
Benchmark library

The tests, not a shelf of abstractions.

Every collection connects frozen targets to measured runs, artifact integrity, cost, time, and visible evidence gaps.

Browse seven collectionsGet source projects with Builder
7versioned benchmark collections
Public comparisons + Builder deliverables

Latest published comparisons

Published comparisons and benchmark evidence stay public. Activated source-project packs and immutable research packs remain separate Builder deliverables.

Campfire output from the published Qwen3.8 Max Preview collectionLaunch 003 · public comparison
42 recorded runsEvidence snapshot 2026-07-23

I Gave Qwen3.8 Max, Kimi K3, GPT-5.6 and Fable 5 the Same 9 Game Tests

Neo-Gothic Storm City · MacBook-Class Cinematic · JRPG Boss Battle · Campfire Under a Starry Night · Space Flight Game · Shrine Village · Infinite Cathedral · Oasis Outpost · Jungle Temple

Evidence available

  • Cost, workflow time, token, stack, artifact, and caveat ledgers
  • Nine frozen Qwen tests with a 42-record comparison pool
  • Nine public Qwen media recordings and linked artifacts
  • Published owner editorial assessment and official video

Still missing

  • Minimum community preference sample
  • Repeat-run reliability evidence
  • A completed Qwen MacBook agent run
Campfire output from the Kimi K3, GPT-5.6, and Claude Fable 5 collectionKimi K3 Launch 002 · v1
33 recorded runsEvidence snapshot 2026-07-19

Kimi K3 vs GPT-5.6 SOL vs Claude Fable 5: 9 Game Tests

Neo-Gothic Storm City · MacBook-Class Cinematic · JRPG Boss Battle · Campfire Under a Starry Night · Space Flight Game · Shrine Village · Infinite Cathedral · Oasis Outpost · Jungle Temple

Project Pack v1 · 33 outputs · 14 Blender · 11 browser · 8 shader25 ready · 5 reference-only · 3 partial · 0 excludedResearch Pack v1 remains a separate immutable receipt download.

Evidence available

  • Cost, workflow time, token, stack, and artifact ledgers
  • Nine frozen tests with 33 featured run records
  • Seven anonymous Kimi-versus-Fable blind matchups
  • Published editorial assessment and official video

Still missing

  • Minimum community preference sample
  • Repeat-run reliability evidence
  • One reconciled Kimi MacBook API request
Space-flight output from the GPT-5.6 versus Claude Fable 5 collectionTech Review 001 · v1
28 recorded runsEvidence snapshot 2026-07-15

GPT-5.6 vs Claude Fable 5: Same Prompts, 7 AI Game-Dev Tests

Infinite Cathedral Corridor · Neo-Gothic Storm City · Space Flight Game · Campfire Under a Starry Night · Jungle Temple · Shrine Village · Oasis Outpost

Evidence available

  • Cost, workflow time, token, stack, and artifact ledgers
  • Seven standardized Fable-versus-Sol comparisons
  • Anonymous blind exploration; sign-in only to record a vote
  • Published editorial assessment and official video

Still missing

  • Minimum community preference sample
  • Repeat-run reliability evidence
Seven scoped collections

Versioned benchmark collections

These seven scopes partition the full measured public corpus. Open one to inspect its model coverage and every result-backed run without implying a standalone package that has not been published.

Space-flight benchmark output in the Space Flight v1 collectionHarness v1
8 measured runsEvidence snapshot 2026-07-19

Space Flight v1

Space Flight Game

Evidence available

  • Six measured run ledgers
  • Public browser builds
  • Cost, token, and workflow timing

Still missing

  • Browser/hardware environment
  • Local FPS
  • Final capture metadata
  • Minimum blind-vote sample
Infinite cathedral shader output in the Shader Frontier v1 collectionHarness v1
17 measured runsEvidence snapshot 2026-07-19

Shader Frontier v1

Neo-Gothic Storm City · Stained Glass Cathedral Shader

Evidence available

  • Fifteen measured run ledgers
  • Shader artifacts with SHA-256
  • Cost, token, and workflow timing

Still missing

  • Initial and optimized local FPS
  • RTX Pro 6000 final-capture metadata
  • Minimum blind-vote sample
Voxel jungle-temple diorama in the Blender Voxel Worlds v1 collectionHarness v1 · Capture protocol v1
22 measured runsEvidence snapshot 2026-07-19

Blender Voxel Worlds v1

Oasis Outpost · Jungle Temple · Shrine Village

Evidence available

  • Nineteen measured run ledgers
  • Primary artifact SHA-256 records
  • Standardized turntable media

Still missing

  • Recorded Blender/render environment for original runs
  • Repeat-run evidence
  • Minimum blind-vote sample
Campfire benchmark output in the Campfire Interactive Scene v1 collectionHarness v1
8 measured runsEvidence snapshot 2026-07-19

Campfire Interactive Scene v1

Campfire Under a Starry Night

Evidence available

  • Seven measured run ledgers
  • Public browser builds
  • Cost, token, and workflow timing

Still missing

  • Browser/hardware environment
  • Local FPS for several runs
  • Final capture metadata
  • Minimum blind-vote sample
MacBook cinematic benchmark output in the MacBook Cinematic v1 collectionHarness v1
4 measured runsEvidence snapshot 2026-07-19

MacBook Cinematic v1

MacBook-Class Cinematic

Evidence available

  • Three measured run ledgers
  • Public recorded outputs
  • Cost, token, and workflow timing

Still missing

  • One reconciled Kimi API request
  • Repeat-run reliability evidence
  • Minimum blind-vote sample
JRPG boss battle benchmark output in the JRPG Boss Battle v1 collectionHarness v1
4 measured runsEvidence snapshot 2026-07-19

JRPG Boss Battle v1

JRPG Boss Battle

Evidence available

  • Three measured run ledgers
  • Public recorded outputs
  • Cost, token, and workflow timing

Still missing

  • Repeat-run reliability evidence
  • Minimum blind-vote sample
RemakeBench voxel collection artworkHarness v1
8 measured runsEvidence snapshot 2026-07-19

Interactive Voxel Viewer v1

Interactive Voxel Map Viewer

Evidence available

  • Seven measured run ledgers
  • Primary artifact integrity records
  • Cost, token, and workflow timing

Still missing

  • Standardized public capture set
  • Repeat-run reliability evidence
  • Minimum blind-vote sample
Community access is free

Discuss the result. Shape the next test.

Join after signing in. Builder membership adds the published source-project and research packs; it is not required for the community Discord.

Join the verified member Discord →