Which Benchmarks will OpenAI show results from GPT-5 on, when it is announced?
11
1kṀ2815
2026
94%
SimpleQA
13%
GSM8K
71%
HumanEval
82%
MMLU
80%
GPQA
62%
MATH
41%
MGSM
32%
DROP
52%
Big-Bench-Hard
87%
SWE-Bench

Some flexibility on variations of specific benchmarks. eg SWE-Bench-Hard would resolve SWE-Bench YES.

  • Update 2025-05-11 (PST) (AI summary of creator comment): The benchmarks must be those that GPT-5 is benchmarked against by OpenAI.

Get
Ṁ1,000
to start trading!
Sort by:
bought Ṁ10 NO

you mean benchmarked by OpenAI?

@bbb I can't add options, I might create a duplicate where i can in a bit.

© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules