When GPT5 comes out, lists its capabilities according to all quantifiable metrics, and compare that to the same for GPT4 and GPT3.
If Capabilities(GPT5-GPT4) < Capabilities(GPT4-GPT3), this market resolves YES.
Otherwise, this market resolves NO.
This is regardless of whether there are diminishing returns in the cost required to get from GPT4 to GPT5.
Related questions
@VictorLi We’ll take an average of all the top metrics and use that to start with.
If the results are still unclear or ambiguous, we’ll look at what each metric represents and I’ll use my best judgment based on what we can now do that we couldn’t do before.
Silly example: the standard metrics are all pretty middling, but also it teaches us how to speak to dolphins and turn lead into gold using nothing but Alka seltzer and chewing gum, and also decodes Linear A and proves P=NP, even if the metrics were boring in the face of undeniable new capability jumps like that which aren’t well captured by standard metrics alone I would have to call that a massive leap. (You could also express new quantifiable tests for all these new capabilities, and then test GPT4 and GPT3 against them)