@PestoPastel could you close this? it's "NO" as of like 17k steps ago

@ointment unless the market owner needs to close it, I'm unsure how that works

@ointment Also

Claude enters Rock Tunnel before Step 150,000

The streamer ClaudePlaysPokemon announces that there will be a reset before step 200000

Claude reaches Lavender Town before Step 200,000

claude has passed step 200000

Claude has:
-A Pokemon that reached level 40 (Sand)
-Evolved a Clefairy into Clefable (STAR)
-Reached 150,000 steps without entering Rock Tunnel

@JoeandSeth It resolves to NO as it had only 4 or 5 Pokemons at 150k steps despite having 6 now.

@BlitzEver agreed. I don't have permissions to resolve though

@JoeandSeth Already resolved, it was just to help the resolution with all these questions haha. Ty anyway

All answers pertaining to Gemini are ill defined. Gemini's setup is very different from Claude's. Gemini gets a large scale map automatically that gets filled in as tiles are explored, so he can see beyond the current screen. This is an external input, not something Gemini makes by itself.

This is a huge advantage, and makes the two experiments incomparable.

Gemini also gets a tile-by-tile definition of each tile, so it can see cuttable trees for example. It doesn't have to understand the images.

@Mqrius Does anyone care that Gemini is cheating? I can resolve the answers N/A if people are up in arms about this, inclined to just let its results stand though even though it has an advantage over Claude

@SaviorofPlant I dunno I have no stakes in this. Just saying it's ambiguous what would count or not. Gemini is a few steps to the right on a continuous scale to things like "A human is playing and the AI tells the human what to do" or vice versa.

This is more of a problem for an answer like this ("another AI model surpasses Claude (gym badges)"), which is about any AI model. Less of a problem with an answer like "Gemini advances further (overall; not instantaneously) than Claude at any point", where we can assume it's about the GeminiPlaysPokemon stream no matter its advantages (but it would still be better if that was explicitly stated!).

@Mqrius I made it just to capture if progress will be faster with a different model/setup. Claude is also “cheating” by having direct access to some of the memory and pathing tools. It seems unlikely right now that we’ll see two models with the exact same setup, token usage rate, etc. in a controlled experiment even though that would be more interesting.

I would contend that any setup where the decisions are not made based on input and output from a statistical model should not count (I.e. a custom traditional video game AI with a series of if statements and predefined algorithms coded in). The rest is going to be subjective matters of degree and not kind until someone runs a model which can only see the actual screen and only press specific buttons more closely analogous to an actual human interacting with a gameboy.

holy stonks. i am the prophet

@No_uh i realized i didn't include the screenshot. i think 34 to 1 is the best ive ever come out on a bet here

@SaviorofPlant - Diglett is in the front of the party. Since some time in the last 24 hours or so.

@SaviorofPlant

Puff evolves into Wigglytuff

Claude gets Flash

Claude has obtained a Magicarp, caught a Clefairy, entered Cerulean and gone back to Mt Moon, and talked to the Flash guy while meeting the requirement but answered no. If you need more info let me know I can find the stuff from reddit.

Oh also boxed two Pokemon, Shel and Sting.

[deleted]

@Multicore grass is a type. Jigglypuff is a species

@SaviorofPlant why has this not resolved yes? He's been through Moon a few times now, no?

@JoeandSeth I'm pretty sure this Claude has only made it through Mt. Moon to Cerulean once. The second time he entered Mt. Moon after Cerulean (~80 hours ago), he exited through the entrance and wandered back to Viridian City, which means this option resolves NO. Someone correct me if this is wrong.

@SaviorofPlant shouldn't resolve NO, yet, unless this was always going to resolve no, since Claude can't go back in time? Thought this was "he traverses Mt Moon, from Pewter to Cerulean, faster than the first time, at any point in the remainder of the run"

@JoeandSeth but I'll admit to only seeing him in Moon a few times (like rn) but not watching continuously to see which way he had left.

@JoeandSeth This is a good point, phrasing of the answer implies it doesn't matter whether it's his second or fourth attempt. But I'm struggling to qualify what counts as a "re-entry", as Attempt 1's 69 hours includes some time wandering around Route 3 and Route 4. Should going back to Pewter and then going back to Mt. Moon counts as a "re-entry" but going back to Route 3 not count? Could also interpret it as "time of return to Cerulean" - "time of first mt. moon entry after last reaching Cerulean". And technically Claude could leave Mt. Moon through the entrance then take Diglett Cave to Cerulean, does that count as an escape?

Tempted to N/A this option, my phrasing was atrocious

@SaviorofPlant yeah, tricky. Imo this would only count for a proper traverse, but that's still moot

@SaviorofPlant

It happened. Idk exactly when you'd say it started

@JoeandSeth 31 hours since most recent entry after Pewter, 109 hours since first entry after Diglett Cave. Can resolve YES based on former value since it seems like most traders interpreted it that way, unless anyone has any complaints