RotomArenaAI gaming benchmark • 2 benchmarks

Retracted · 2026-08-29 · rules version v0

direct_llm_p1_eda0 vs heuristic_p2_5ebe

Retracted. This match was voided: direct_llm was on autopilot for 100% of its turns. It is kept for transparency and does not count toward any rating. Why we retracted the pilot study.
Player 1 · winner
direct_llm_p1_eda0
team not recorded
autopilot 100%
Player 2
heuristic_p2_5ebe
team not recorded

direct_llm_p1_eda0 won in 22 turns · 12 s wall clock

The replay player loads from play.pokemonshowdown.com. The full battle log is below.

Decisions

  1. Turn 1
    heuristic_p2_5ebe used Kowtowcleave
    direct_llm_p1_eda0 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  2. Turn 2
    heuristic_p2_5ebe used Kowtowcleave
    direct_llm_p1_eda0 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  3. Turn 3
    heuristic_p2_5ebe used Kowtowcleave
    direct_llm_p1_eda0 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  4. Turn 4
    heuristic_p2_5ebe used Kowtowcleave
    direct_llm_p1_eda0 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  5. Turn 5
    heuristic_p2_5ebe switched to Ogerpon
    direct_llm_p1_eda0 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  6. Turn 6
    heuristic_p2_5ebe used Ivycudgel
    direct_llm_p1_eda0 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    heuristic_p2_5ebe switched to Kingambit
  7. Turn 7
    heuristic_p2_5ebe switched to Gholdengo
    direct_llm_p1_eda0 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    heuristic_p2_5ebe switched to Kingambit
  8. Turn 8
    heuristic_p2_5ebe switched to Ribombee
    direct_llm_p1_eda0 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  9. Turn 9
    heuristic_p2_5ebe used Moonblast
    direct_llm_p1_eda0 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    direct_llm_p1_eda0 switched to Greatautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  10. Turn 10
    heuristic_p2_5ebe used Moonblast
    direct_llm_p1_eda0 used Headlongrushautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    direct_llm_p1_eda0 switched to Ting-Luautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  11. Turn 11
    heuristic_p2_5ebe used Moonblast
    direct_llm_p1_eda0 used Earthquakeautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  12. Turn 12
    heuristic_p2_5ebe used Moonblast
    direct_llm_p1_eda0 used Earthquakeautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    heuristic_p2_5ebe switched to Kingambit
  13. Turn 13
    heuristic_p2_5ebe switched to Iron
    direct_llm_p1_eda0 used Earthquakeautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  14. Turn 14
    heuristic_p2_5ebe used Moonblast
    direct_llm_p1_eda0 used Earthquakeautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  15. Turn 15
    heuristic_p2_5ebe used Moonblast
    direct_llm_p1_eda0 used Earthquakeautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    direct_llm_p1_eda0 switched to Dragapultautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  16. Turn 16
    heuristic_p2_5ebe used Moonblast
    direct_llm_p1_eda0 used Shadowballautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    direct_llm_p1_eda0 switched to Gholdengoautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  17. Turn 17
    heuristic_p2_5ebe used Shadowball
    direct_llm_p1_eda0 used Shadowballautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    heuristic_p2_5ebe switched to Kingambit
  18. Turn 18
    heuristic_p2_5ebe switched to Samurott
    direct_llm_p1_eda0 used Shadowballautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  19. Turn 19
    heuristic_p2_5ebe used Ceaselessedge
    direct_llm_p1_eda0 used Shadowballautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    direct_llm_p1_eda0 switched to Dragoniteautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  20. Turn 20
    heuristic_p2_5ebe used Ceaselessedge
    direct_llm_p1_eda0 used Extremespeedautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
  21. Turn 21
    heuristic_p2_5ebe used Ceaselessedge
    direct_llm_p1_eda0 used Extremespeedautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.
    heuristic_p2_5ebe switched to Kingambit
  22. Turn 22
    heuristic_p2_5ebe used Kowtowcleave
    direct_llm_p1_eda0 used Extremespeedautopilot
    Incident report
    LLM API Call Error: name 'asyncio' is not defined. Executed fallback action.