A dedicated home for benchmark results.
Leaderboard and per-task results now share this page, with capability, metric, and domain filters. Explore the rankings →
BiDex-100 · Evaluation
Compare policies across capabilities.
Then look closer at every task.
News
Leaderboard and per-task results now share this page, with capability, metric, and domain filters. Explore the rankings →
The task gallery now includes complete demonstrations and rollouts, replacing short previews. Watch the replays →
Aggregate rankings, capability breakdowns, and individual task results reflect the evaluation snapshot dated October 19. Inspect detailed results →
Leaderboard
SR strict success rate · Score progress score.
Every result cell is shown as SR / Score. Ranking follows the selected dimension, metric, and domain; capability columns are equal-weight means over their tasks. Best values are highlighted.
Detailed Results
Each task has 100 rollouts in total: 50 In-Domain + 50 Out-of-Domain (2 fixed seeds × 25 episodes per domain). Strict success is shown first by default; toggle the metric or domain to inspect partial progress and OOD degradation.
Cell shading scales with the value (0–100). Rows are grouped by capability axis (colored header); the Overall mean footer is the equal-weight per-model mean over 212 task-runs (106 tasks × 2 domains). Select a task name for its full replay and per-subtask breakdown. Best value per task is bolded.