Gen 9 OU · fixed teams · 40 rated games · updated 2026-10-17

Gen 9 OU · fixed teams

Archived. A superseded version, kept for the record; its games count on no current leaderboard. The current one is Rotom Gen9 Bench.

Every pairing plays the same two Gen 9 OverUsed teams from both sides; teambuilding not measured.

Ratings are on the Elo scale, fitted by Bradley-Terry over this board's rated games. Games are only played once; each leaderboard is a different selection of them. Bonsai 2 27B is fixed at 1500 by definition; every other number is relative to it.3Models with fewer than 16 games are marked provisional. Click a column to sort.

StructurePrice
#ModelRating (95% CI)1GamesWLWin rateHalluc.2Tokens / turnCost / game
—PokéChamp1802+331−2441612475%———
1Nemotron 3 Ultra1707+296−2471510567%20.3%1,300free
2Ling 3.0 Tiny1677+339−33774357%2.8%2,352free
3Gemma 4 31B1583+280−221157847%3.3%754$0.005
4Bonsai 2 27B15001551033%1.3%1,784free
—Chimps at the Zoo1356+259−3521221017%———
Rules

Every game records the rules it was played under; a board only rates games that match their version's stored rules.

VersionFormatTeamsBringThinking per turnTokens per turnPrompt
s1gen9oufixed: balance, hyper_offenseall 6medium4,096ba3dda5d9965
8001000120014001600180020002200PokéChampNemotron 3 UltraLing 3.0 TinyGemma 4 31BBonsai 2 27BChimps at the Zoomodelbotanchor (fixed at 1500)
Figure 1. Ratings with 95% parametric bootstrap intervals; the bars end at the interval bounds. The hollow point is the anchor, whose interval is zero by construction, and the vertical line marks its rating. Overlapping intervals mean we cannot tell two models apart, which is most of them.

Head to head

Wins–losses of the row model against the column model. Click a record for its games and replays.

PokéChampNemotron 3 UltraLing 3.0 TinyGemma 4 31BBonsai 2 27BChimps at the Zoo
PokéChamp·
Nemotron 3 Ultra·
Ling 3.0 Tiny···
Gemma 4 31B·
Bonsai 2 27B·
Chimps at the Zoo·

    1. 95% intervals come from 1,000 parametric bootstrap refits. When an interval covers half the chart, the model has not played much yet, or plays very inconsistently, or both.
    2. Hallucination rate: the share of turns where the model gave no usable answer (named a move it does not have, answered in a format we could not read, rambled past its token budget, timed out or errored) and the default move was played on its behalf. Matches where either side does this on more than 50% of its turns are voided.
    3. Ratings need a reference point. We chose a local open-weights model because it is always available, costs nothing to run, and cannot be deprecated by its vendor while we sleep.