Compare models

Up to five models, tasks down the page. A cell is passes / judged runs for that task. N/A means that model has no run there.

Select models (max 5) · 1 of 5

TaskGPT-6 Astra (low) planner + Jev 1.13 actor4/4 judgedOpenAI Codex (planner) + TypeSafe via OpenRouter (Jev) · Provider not separately recorded
All judged runspasses / judged runs100%4/4 passes / judged runs
Apple CarryCarry an apple onto a plate on two embodiments: an xArm7 in OpenRoboto's MuJoCo scene, and an FR3 with a Robotiq 2F-85 on SuperDex.100%1/1 passes / judged runs
Apple StemPinch an apple by the stem and lift it with a Wuji hand on an FR3 arm in SuperDex, without contacting the apple body.100%1/1 passes / judged runs
Dex Cube TurnTurn one face of a Rubik's cube a quarter turn by finger contact with two dexterous hands in MuJoCo.100%1/1 passes / judged runs
Eiffel Tower DrawingDraw the Eiffel Tower with a friction-held pencil on a Marvin arm and Wuji hand in MuJoCo.100%1/1 passes / judged runs

The stronger green cell is the best pass rate in that row. Ties share it. Unjudged runs are left out of the rate.

RemakeBenchResearch console