Will model weights obtaining >90% on the Winogrande benchmark become publicly available in 2024? | Manifold

Will model weights obtaining >90% on the Winogrande benchmark become publicly available in 2024?

3

110Ṁ31

resolved Feb 25

Resolved

YES

1H

6H

1D

1W

1M

ALL

I will use the leaderboard at https://paperswithcode.com/sota/common-sense-reasoning-on-winogrande unless someone has a better suggestion. Model weights do not have to be licensed without restrictions but must be available for download.

Technical AI Timelines

Get

1,000

to start trading!

People are also trading

Will OpenAI offer a model that updates its weights while running during 2025?

When will Grok 3 weights become publicly available?

Will the gap between open-weights and frontier models on GPQA Diamond be at most 7%?

Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?

Have Claude Sonnet 4.5 model weights leaked before October 2025?

Will GigaChat release an open-weights model with ≥100B parameters by the end of 2026?

Claude 3 Opus model weights publicly available by EOY 2030?

Will OpenAI allow near full access to the weights of their best-trained model to an external auditor by the end of 2030?

When will the weights of GPT-4 be publicly available (leaked or open sourced)?

When will Llama 4 Behemoth weights become publicly available?

Sort by:

What model resolved this yes? I can see code on GitHub but I can't seem to find model weights for any of the top models.

@ProjectVictory https://github.com/allenai/rainbow?tab=readme-ov-file#downloading-the-weights Seems to fulfill the criteria, I would say, and comes in at 91.3 on the leaderboard. It's actually older than the question, so i guess this was just a matter of the leaderboard getting updated -_-

GitHub - allenai/rainbow: Neural models of common sense. 🤖

Neural models of common sense. 🤖. Contribute to allenai/rainbow development by creating an account on GitHub.

@Thomas42 thanks I missed the download instructions it seems.

Comment hidden

People are also trading

Will OpenAI offer a model that updates its weights while running during 2025?

When will Grok 3 weights become publicly available?

Will the gap between open-weights and frontier models on GPQA Diamond be at most 7%?

Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?

Have Claude Sonnet 4.5 model weights leaked before October 2025?

Will GigaChat release an open-weights model with ≥100B parameters by the end of 2026?

Claude 3 Opus model weights publicly available by EOY 2030?

Will OpenAI allow near full access to the weights of their best-trained model to an external auditor by the end of 2030?

When will the weights of GPT-4 be publicly available (leaked or open sourced)?

When will Llama 4 Behemoth weights become publicly available?

Related questions

Will OpenAI offer a model that updates its weights while running during 2025?

When will Grok 3 weights become publicly available?

Will the gap between open-weights and frontier models on GPQA Diamond be at most 7%?

Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?

Have Claude Sonnet 4.5 model weights leaked before October 2025?

Will GigaChat release an open-weights model with ≥100B parameters by the end of 2026?

Claude 3 Opus model weights publicly available by EOY 2030?

Will OpenAI allow near full access to the weights of their best-trained model to an external auditor by the end of 2030?

When will the weights of GPT-4 be publicly available (leaked or open sourced)?

When will Llama 4 Behemoth weights become publicly available?

© Manifold Markets, Inc.•Terms•Privacy