Will any open-source model achieve GPT-4 level performance on MMLU through 2024?

1kṀ13k

resolved Dec 9

Resolved

YES

ALL

GPT-4 currently leads the Multi-task language understanding benchmark [1] at 86.4% [2]. Will any open-source language model achieve at least 86.4% on MMLU average?

A leaderboard of open-source models can be found here.

Technical AI Timelines

GPT-4 speculation

Get

1,000

to start trading!

🏅 Top traders

#	Name	Total profit
1		Ṁ432
2		Ṁ329
3		Ṁ49
4		Ṁ46
5		Ṁ41

Comments

19 Holders

55 Trades

People are also trading

Will we have an open-source model that is equivalent GPT-4 by end of 2025?

82% chance

Size of smallest open-source LLM marching GPT 3.5's performance in 2025? (GB)

1.83

Will an open-source fully functional Auto-GPT like LLM exist by the end of 2025?

90% chance

When will an open-source LLM be released with a better performance than GPT-4?

Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?

83% chance

Will a GPT-4 level system be trained for <$1mm by 2028?

89% chance

🏅 Top traders

People are also trading

Related questions