GPT-5 has reached Victory Road! This is the last challenge before the Elite Four.
GPT-5 reached this part almost three times faster than o3 (6105 steps for GPT-5 vs 16882 steps for o3). Here are my observations as to why:
- GPT-5 hallucinates far less than o3. This is the main reason for the speed increase.
- GPT-5 has better spatial reasoning. o3 often tried to brute-force through walls and had a hard time navigating complex areas. GPT-5 can plan long input sequences with few mistakes, which saves a lot of time.
- GPT-5 is better at planning its own objectives and following them.
Let's see how it handle this last challenge!
Livestream: https://www.twitch.tv/gpt_plays_pokemon
Statistics and comparative data: https://gpt-plays-pokemon.clad3815.dev/timeline
