Resolves YES if an AI can beat me or a similarly-skilled player at least 4 times out of 10 games in a mirror-match. (The AI and I both have the same deck and the same amount of time, with at least 30 minutes per game.) Only the strategical decisions must be made by the AI; a human can do the card motions (if tabletop) or clicking and data entry (if online).
Any reliable evidence that this has occurred is sufficient: e.g. a paper published where the researchers claim to have run such a test.
The AI can't be designed for the specific deck it's playing, it needs to be general-purpose. It does get to know in advance of the game what cards are in the deck it's been given. Any reasonable deck for a serious format is fine; it can't just be Forests and Grizzly Bears.
Related questions
The AI can't be designed for the specific deck it's playing, it needs to be general-purpose
Does this mean it needs to be able to play a deck without "practicing" with it before? If so, I expect this to be nearly impossible. Magic rules are incredibly compliated and the action space such an agent will need to learn without practicing is immense. On the other hand, an AI that can play a certain mirror but can easily be retrained to play other mirrors seems very plausible.
@ChameLeon Yeah, I feel like these are substantial ambiguities. I predict human level performance for an AI piloting mono-red before KCI.