In a traditional game an attempt to make an illegal move results in a forfeit of the match. Does this rule apply to GPT-5?

@Soren Yeah I think it should. Someone who can't even move legally is clearly not "a good player" by the common-sense meaning of the term.

An estimated rating is fine.

Estimated what? Bona fide FIDE Elo? TCEC compatible computer rating? Stockfish tournament result? Lichess.com??

https://twitter.com/andrew_n_carr/status/1735418595759526231

@NoaNabeshima https://twitter.com/GrantSlatton/status/1703913578036904431

@NoaNabeshima I'm not checking these tweets, but this is why I'm trading as I am

Market is so dramatically unspecified as to make it impossible for me to bet.

@mqp *underspecified

@mqp What's the concern? If GPT-5 is able to consistently beat people rated 2000 or above, then it resolves YES.

@IsaacKing having rating of 2000 you will only beat people rated 2000 half of the time, so you are either unclear in this comment or in the title (or do you consider 50% as consistently?)

@IsaacKing results against humans is not a good benchmark (there may not be enough games for statististically sound evaluation, for one thing).

But also, the principal question is: what Elo does this refer to? Many if not most online discussions these days refer to online rating systems, like that of chess.com or Lichess, rather than the classical FIDE Elo. And this is a very important distinction for the context of this market! The baseline Elo performance for GPT-3 (and presumably GPT-4, which actually appears to "play" worse but that is likely just a statistical fluke) is about 1700 on the CCRL scale. This would translate to easy blitz wins over most 2000 rated players on either chess.com or lichess, whose rating scales are inflated by several hundred points