This could potentially resolve YES in a few months:

https://deepmind.google/discover/blog/sima-generalist-ai-agent-for-3d-virtual-environments/?utm_source=twitter&utm_medium=social&utm_campaign=SIMA/

@benshindel "A few months" is seems very unlikely to me. Note that this paper only has the AI doing simple tasks that take ~10 seconds to complete, and only when instructed. Having it able to do the kinds of long-term tasks most games require seems like a pretty big step - one that would take years, not months, of progress.

@MetallicDragon

1) “Human level” in most games is not as high of a bar as you think. It doesn’t need to “beat all humans” at the game.

2) Once this tool is released to game devs to use, it will become rapidly more clear whether it has the potential to be at the versatility and the level required for this market.

That’s what I meant by “in a few months”: once we see how this is used by the public or by a wider range of developers

Hoping this can play Inflection Point, because there's currently no single player option, and it's hard to get people to play with me.

https://inflectionpointgame.com/

.

Will this resolve NA or NO if no news of any attempt to achieve this comes about?

@MatthewLeong markets like this should resolve NO if there is no information to make it resolve YES. Scott Alexander is a trustworthy market creator, so there shouldn't be any shenanigans.

@FlorisvanDoorn - If that's the case, then I feel like this won't be a specific goal of an AI research team, and so won't happen by default, despite potentially being possible.

I think we're in the realm of having LLMs with plugins, or things of that nature, and no longer focussing on conquering games as we have in the past.

If the AI is accessing the state of the game in a way a human cannot, will that count? I would say that if it has direct read and write access to game state, rather than HDMI-in and HID-out access to the game, it’s not playing the game at all.

Regardless, I don’t think that a couple of days will be sufficient to learn how to play randomly selected game from scratch even with total read access to the game state and HID-out access to control it.

Seems hard to test. Do you have a programming team in mind? Supposing they don't follow these rules, (ie., randomly selected games, days not years for connecting, practice/play time, and somehow evident or reported to you/us) would you resolve N/A, or draw your best conclusions?

"AI may learn with ease,
But can it match human expertise?
In gaming, it's a whole new fight,
But with time, perhaps it'll play right."

Pretty sure this already occurred

@Gigacasting deepmind was able to do this with atari games

so this resolving to yes is just a matter of incremental progress. We'd have to suffer another winter imo for this to resolve to no.

To resolve positively, is it required that the AI can complete training using only the GPU on a normal person's computer? This requirement seems implied by the original article's use of the phrase "off-the-shelf AI" but I could be misinterpreting what that means.

@MichaelDickens Alternatively, "off-the-shelf" just means it's a general-purpose game-playing AI, rather than custom-built for a specific game

This seems AGI-complete, in that it's isomorphic to saying "an ai will be able to perform totally arbitrary tasks on a computer's ui which involve complex planning (basically the whole strategy genre)"

@AaronKaufman I don't think so. The prompt is giving it a few days to connect and practice, and a random game on average has only a few inputs you can perform, as well as several limiting rules. If the random game is Minecraft the AI might be screwed, but if it's Celeste maybe it is getting close already?

@AaronKaufman It does involve re-training of weights. How much can the model learn with the given set of weights such that it is not only able to perform well at the tasks its optimized its weights for but also learn to do new tasks from very very few examples

@vmjusto Anything that can be played with an Xbox controller has the same number of inputs, even if it ignores some of them.

80%