Is FiveThirtyNine AI better than Metaculus?
22
1kṀ33382029
7%
chance
1H
6H
1D
1W
1M
ALL
Center for AI Safety announced a forecasting AI that allegedly outperforms Metaculus. However, Oliver Habryka and Gwern raised concerns about data contamination. If a reliable (according to me) test is performed, will FiveThirtyNine be found to outperform Metaculus?
If all concerns with the current test will be convincingly debunked, the market will resolve YES. If a new test will involve Metaculus forecasts that contain similar AI in the aggregate, it will not be sufficient for a NO resolution. If no such test is performed by closing date, it will resolve MKT. Since what counts as a "reliable test" is a subjective judgment call, I will not trade on this market. I also welcome suggestions for better resolution criteria.
See also:
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000People are also trading
Related questions
Will Metaculus be around in 10 years?
72% chance
Will Metaculus still exist and have active forecasting throughout 2025?
93% chance
Will AI progress surprise Metaculus?
77% chance
Will pre-2026 AI out-forecast the Metaculus community?
58% chance
Will Metaculus still exist and have active forecasting throughout 2035?
42% chance
Will Metaculus still exist and have active forecasting throughout 2030?
82% chance
Will Manifold surpass Metaculus in DAUs by 2025?
50% chance
Will Metaculus still exist and have active forecasting throughout 2026?
90% chance
Why does Metaculus calculate their overconfidence score like this?
Ṁ0 bounty