LLM reaches >90% Brier score on Prophet Arena by 2026?
8
1kแน€796
Dec 31
24%
chance

Prophet Arena evaluates the ability of LLMs to forecast the future by letting them predict on live prediction markets (Kalshi).

As of 2025-08-18, the current leader in Brier score is GPT-5 with 82.21%.

Resolves YES, if an LLM manages to reach over 90% on the leaderboard for at least one week (to prevent lucky outliers).

Resolves NA, if the website stops being maintained for at least one month.

Resolves NO, otherwise.

AI
Technical AI Timelines
Science
AI Benchmarks
Prophet Arena
Get
แน€1,000
to start trading!
Sort by:

@kiudee I think you mean 1 - brier score, which is what they report. a 10% or less brier score (less is better) would mean a 90% or more score on the Prophet Arena

that's minor and presumably nobody would be confused but probably worth clarifying the description

To confirm, that's what I meant. Thanks for the keen eye.

People are also trading

What organization will top the LLM leaderboards on LMArena at end of 2025? ๐Ÿค–๐Ÿ“Š
LLM Hallucination: Will an LLM score >90% on SimpleQA before 2026?
60% chance
Will an LLM report >50% score on ARC in 2025?
99% chance
Who will have the best LLM at the end of 2025 (as decided by ChatBot Arena)?
Will the highest-scoring LLM on Dec 31, 2026 show <10% improvement over 2025's best average benchmark performance?
59% chance
400-point pwn solved by an LLM by 2025
47% chance
Will there be an LLM which scores above what a human can do in 2 hours on METR's eval suite before 2026?
70% chance
Will LLMs mostly overcome the Reversal Curse by the end of 2025?
59% chance
Which LLM will have the highest ELO at the end of 2025 on ChatBot Arena?
What will be true of OpenAI's best LLM by EOY 2025?
ยฉ Manifold Markets, Inc.โ€ขTermsโ€ขPrivacy