BuilderBuilder
Claude Sonnet 5.5 · ATS depot driving
The episode shows Opus on high missing the turn inside the depot, then Astra on high reaching the road and then taking the wrong lane movement before the run is stopped. Neither completes the route. Sonnet has a same-window ledger and is not narrated: it stays in the depot. There is no GPT-6.1 Sol ledger. All three statuses are historical_exploratory_import_incomplete. No route is recorded as passed. Supplied source capture Unaided model Open this round
Measured harness ledgerPublic result
Claude Sonnet 5.5

ATS depot driving — Claude Sonnet 5.5

Leave the ATS depot, join a public road, negotiate the first junction, and stop safely.

High reasoningHeadline result
Workflow cost
$0.45
Wall-clock
2m 56s
Processed tokens
Input 21,953 (uncached input 6 + cached read 1,056 + cache write 20,891). Output 36,751. Reasoning output 527 is recorded separately and is not added. protocol.malformed_output.output_tokens 36,250 is a separate count and is not added. No processed total is recorded.
Record state
additive_harness_projection
Public summary

Claude Sonnet 5.5 ATS depot driving: 2m 56s, $0.45 API-equivalent estimate, Input 21,953 (uncached input 6 + cached read 1,056 + cache write 20,891). Output 36,751. Reasoning output 527 is recorded separately and is not added. protocol.malformed_output.output_tokens 36,250 is a separate count and is not added. No processed total is recorded..

Run identity and stack
  • Result ID: ats-depot-driving-claude-sonnet-5.5-high-2026-10-02
  • Technical model: claude-sonnet-5-5
  • Provider: Anthropic Claude Code
  • Client: Claude Code CLI
  • Stack: American Truck Simulator visual driving
  • Stack: Historical exploratory import
Cost basis
  • Clock is supplied_measurements.active_wall_seconds. Cost is supplied_measurements.cost.estimated_cost_usd. billed_cost_usd is null.
  • Source: supplied_measurements.token_usage.input_tokens at harness commit 9b7c614dbb5103cc373fdf6275b5c4efc10d8f0e.
Validation evidence
  • Result: historical_exploratory_import_incomplete
  • Verification: Recorded status is historical_exploratory_import_incomplete. Pending, partial, stopped, qualified, and model-finished states stay unjudged. Additive projection from harness commit 9b7c614dbb5103cc373fdf6275b5c4efc10d8f0e. Broad harness sync was not run. Clock is supplied_measurements.active_wall_seconds. Cost is supplied_measurements.cost.estimated_cost_usd. billed_cost_usd is null. Source: supplied_measurements.token_usage.input_tokens at harness commit 9b7c614dbb5103cc373fdf6275b5c4efc10d8f0e.
Recorded caveats
  • Same-window attempt. The episode does not narrate Sonnet. The run stayed in the depot. Route not completed.
  • Clock is supplied_measurements.active_wall_seconds. Cost is supplied_measurements.cost.estimated_cost_usd. billed_cost_usd is null.
  • Source: supplied_measurements.token_usage.input_tokens at harness commit 9b7c614dbb5103cc373fdf6275b5c4efc10d8f0e.
Visible evidence gaps
  • additive projection; broad harness sync was not run
  • source harness commit 9b7c614dbb5103cc373fdf6275b5c4efc10d8f0e
Public result only

This result keeps its public summary and evidence, but it does not currently have a matching Builder test with prompts, projects, Harness workflows or skills.

Browse BuilderReturn to Claude Sonnet 5.5
RemakeBenchResearch console