How many parameters will GPT-4 have?
How many parameters will GPT-4 have?
resolved by
58
3.3kṀ33k
resolved May 12
100%94%
>1600
0.0%Other
0.0%
300
0.1%
350-400
0.0%
401-450
0.0%
451-500
0.0%
501-550
0.0%
551-600
0.0%
601-700
0.0%
701-800
0.0%
801-1000
0.2%
1001-1200
0.2%
1201-1400
0.6%
1401-1600
3%
801-1600
0.4%
301-349 or <300
0.1%
1200B exactly
1.0%
1000B-1400B
0.1%
Yes

GPT-3 has a staggering 175 BILLION parameters


To put it into context
Hugging face's 176 Billion parameter model took 3.5 months on 384 top-of-the-line GPUs to train...

GPT-3 is also over 2 years old.

Nov 17, 1:56am: How many parameters with GPT-4 have? → How many parameters will GPT-4 have?

AI
Science
GPT-4 speculation
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ2,055
2Ṁ1,939
3Ṁ780
4Ṁ768
5Ṁ632


Sort by:
10mo

creator inactive - resolving to >1600

10mo

@shankypanky just for curiosity, what source did you use?

10mo

@Lorenzo fair question! as this market - Will GPT-4 have over 1 trillion parameters? - resolved yes, >1600 is the only suitable option here

1y

Why there's a 801-1600 option, and 4 separate 801-1000, 1001-1200, 1201-1400, 1401-1600 options? How will this resolve if iGPT-4 has, say, 1050 parameters? Both the wide and the narrow options will be chosen? With which weights?

1y

This market is weird.

1y

@MayMeta GPT-4 recommends weighting by the reciprocal of the interval length.

i.e. The 800-wide entry should get a weight of 1/800 if the answer is in there. A 100-wide entry would get a weight of 1/100, so 8x more.

2y

I also notice that there are answers that overlap with each other @JustinKwong

2y

@NoaNabeshima oops, @JustinTorre

2y

The units for these answers are in B of parameters, right??? @JustinTorre

2y

@NoaNabeshima lmao

2y

If GPT-4 is a MoE model it will probably have >1600B parameters.

2y

Hugging face's 176 Billion parameter model took 3.5 months on 384 top-of-the-line GPUs to train...

Note that HuggingFace's model was trained on 350B tokens. The Chinchilla optimal amount of tokens for a 175B model is 3500B tokens, so 10x as much!

2y

Started one with a numeric answer:

2y
2y

in billions, I assume?

2y

@Nikola Bars (300-350, 350-400, 400-450) seem better for this kind of market, right?

2y

@Nikola Or just a market for a numerical value

What is this?

What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Or create your own play-money betting market on any question you care about.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like betting still use Manifold to get reliable news.
ṀWhy use play money?
Mana (Ṁ) is the play-money currency used to bet on Manifold. It cannot be converted to cash. All users start with Ṁ1,000 for free.
Play money means it's much easier for anyone anywhere in the world to get started and try out forecasting without any risk. It also means there's more freedom to create and bet on any type of question.

Related questions

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules