As seen in this graph, Claude has gotten much better at playing Pokemon over its iterations. Resolves yes if before 2027 an Anthropic LLM manages to beat the elite 4 in Pokemon Red or Blue using the same or similar scaffolding to the one Claude used here
1,000Would beating Yellow version resolve yes?
Red version, which Claude is currently playing, has the ability to soft lock if you run out of money before you get the Safari Zone HMs. In Blue version, you can technically string together paydays from wild Meowth to break the soft lock, but that's more difficult than just avoiding the soft lock in the first place. Yellow version, lets you enter the Safari Zone without any money, removing the soft lock entirely.
Claude blacks out a lot. And the Safari Zone limits how many steps you can take before you're kicked out and forced to pay a fee again. I don't think Claude in its current state can defeat the Safari Zone without running out of money. But if it played Yellow version, and the stream had a lot of patience, it may very well break through.