When will WeirdML be at ≥ 80% official score?
1
Ṁ100Ṁ252027
1H
6H
1D
1W
1M
ALL
34%
Before November 2026
41%
Before January 2027
50%
Before March 2027
66%
Before May 2027
WierdML (https://htihle.github.io/weirdml.html) just got it's third release. How fast will LLMs saturate this benchmark? The current best model is GPT-6 Astra with 42%. Note that the "official score" is different from the "final best" as it also takes the token efficiency into account by using the area under the curve.
The models has to be publicly released to count.
If the benchmark is rewored, similar to FrontierMath, then the reworked scores count.
I will add more buckets as needed.
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
People are also trading
Related questions
In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?
8/29/26
What year will the first AI exceed 80% on MLE-bench?
In what year will AI achieve a score of 95% or higher on the GSO benchmark?
1/8/28
In what year will AI achieve a score of 95% or higher on the PutnamBench leaderboard?
7/1/28
In what year will AI achieve a score of 85% or higher on the SimpleBench leaderboard?
6/8/32
Will an LLM score >=95% on SimpleBench before 2028?
81% chance
Will an AI achieve a perfect score on the Miklós Schweitzer Competition before 2028?
83% chance
In what year will AI achieve a score of 95% or higher on the GPQA benchmark?
7/14/26
Top score on Humanity's Last Exam > 80% by what year?
In what year will Al achieve 85% or higher score on the Humanity’s Last Exam benchmark?