RotomArenaAI gaming benchmark • 2 benchmarks

Retracted · 2026-08-29 · rules version v0

direct_llm_p1_a063 vs heuristic_p2_a390

Retracted. This match was voided: direct_llm was on autopilot for 100% of its turns. It is kept for transparency and does not count toward any rating. Why we retracted the pilot study.
Player 1
direct_llm_p1_a063
team not recorded
autopilot 100%
Player 2 · winner
heuristic_p2_a390
team not recorded

heuristic_p2_a390 won in 15 turns · 3 min wall clock

The replay player loads from play.pokemonshowdown.com. The full battle log is below.

Decisions

  1. Turn 1
    heuristic_p2_a390 used Playrough
    direct_llm_p1_a063 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  2. Turn 2
    heuristic_p2_a390 used Ivycudgel
    direct_llm_p1_a063 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
    heuristic_p2_a390 switched to Samurott
  3. Turn 3
    heuristic_p2_a390 used Ceaselessedge
    direct_llm_p1_a063 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  4. Turn 4
    heuristic_p2_a390 used Ceaselessedge
    direct_llm_p1_a063 used Kowtowcleaveautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
    direct_llm_p1_a063 switched to Greatautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  5. Turn 5
    heuristic_p2_a390 used Razorshell
    direct_llm_p1_a063 used Headlongrushautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
    heuristic_p2_a390 switched to Iron
  6. Turn 6
    heuristic_p2_a390 used Moonblast
    direct_llm_p1_a063 used Headlongrushautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
    direct_llm_p1_a063 switched to Ting-Luautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  7. Turn 7
    heuristic_p2_a390 used Moonblast
    direct_llm_p1_a063 used Earthquakeautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  8. Turn 8
    heuristic_p2_a390 used Moonblast
    direct_llm_p1_a063 used Earthquakeautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  9. Turn 9
    heuristic_p2_a390 used Moonblast
    direct_llm_p1_a063 used Earthquakeautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
    direct_llm_p1_a063 switched to Dragapultautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  10. Turn 10
    heuristic_p2_a390 used Moonblast
    direct_llm_p1_a063 used Shadowballautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
    direct_llm_p1_a063 switched to Gholdengoautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  11. Turn 11
    heuristic_p2_a390 used Shadowball
    direct_llm_p1_a063 used Shadowballautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
    heuristic_p2_a390 switched to Gholdengo
  12. Turn 12
    heuristic_p2_a390 used Shadowball
    direct_llm_p1_a063 used Shadowballautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
    direct_llm_p1_a063 switched to Dragoniteautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  13. Turn 13
    heuristic_p2_a390 used Shadowball
    direct_llm_p1_a063 used Extremespeedautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  14. Turn 14
    heuristic_p2_a390 used Shadowball
    direct_llm_p1_a063 used Extremespeedautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.
  15. Turn 15
    heuristic_p2_a390 used Shadowball
    direct_llm_p1_a063 used Extremespeedautopilot
    Incident report
    LLM API Call Error: LLM request failed after 3 attempts: Error code: 429 - [{'error': {'code': 429, 'message': 'Your prepayment credits are depleted. Please go to AI Studio at https://ai.studio/projects to manage your project and billing. Learn more at https://ai.google.dev/gemini-api/docs/billing#prepay. ', 'status': 'RESOURCE_EXHAUSTED'}}]. Executed fallback action.