MANIFOLD
Will model weights obtaining >90% on the Winogrande benchmark become publicly available in 2024?
3
Ṁ110Ṁ31
resolved Feb 25
Resolved
YES

I will use the leaderboard at https://paperswithcode.com/sota/common-sense-reasoning-on-winogrande unless someone has a better suggestion. Model weights do not have to be licensed without restrictions but must be available for download.

Market context
Technology
AI
Technical AI Timelines
Get
Ṁ1,000
to start trading!

People are also trading

When will Grok 3 weights become publicly available?
7/6/26
Have Claude Sonnet 4.5 model weights leaked before October 2025?
1% chance
Will a Ranke-4B model's weights be released publicly before March?
5% chance
Will Anthropic release an open-weights model in 2026?
21% chance
Weights in largest open-weight AI model before July 2026?
Will GigaChat release an open-weights model with ≥100B parameters by the end of 2026?
50% chance
When will Qwen-Image-2.0 weights become publicly available?
3/9/27
Will the gap between open-weights and frontier models on GPQA Diamond be at most 7%?
6% chance
Claude 3 Opus model weights publicly available by EOY 2030?
25% chance
Will a top-10 LMArena model have weight-based online learning by 2027?
25% chance
Sort by:

What model resolved this yes? I can see code on GitHub but I can't seem to find model weights for any of the top models.

@ProjectVictory https://github.com/allenai/rainbow?tab=readme-ov-file#downloading-the-weights Seems to fulfill the criteria, I would say, and comes in at 91.3 on the leaderboard. It's actually older than the question, so i guess this was just a matter of the leaderboard getting updated -_-

GitHub - allenai/rainbow: Neural models of common sense. 🤖
Neural models of common sense. 🤖. Contribute to allenai/rainbow development by creating an account on GitHub.

@Thomas42 thanks I missed the download instructions it seems.

Comment hidden

People are also trading

When will Grok 3 weights become publicly available?
7/6/26
Have Claude Sonnet 4.5 model weights leaked before October 2025?
1% chance
Will a Ranke-4B model's weights be released publicly before March?
5% chance
Will Anthropic release an open-weights model in 2026?
21% chance
Weights in largest open-weight AI model before July 2026?
Will GigaChat release an open-weights model with ≥100B parameters by the end of 2026?
50% chance
When will Qwen-Image-2.0 weights become publicly available?
3/9/27
Will the gap between open-weights and frontier models on GPQA Diamond be at most 7%?
6% chance
Claude 3 Opus model weights publicly available by EOY 2030?
25% chance
Will a top-10 LMArena model have weight-based online learning by 2027?
25% chance
© Manifold Markets, Inc.•Terms•Privacy