Why there's a 801-1600 option, and 4 separate 801-1000, 1001-1200, 1201-1400, 1401-1600 options? How will this resolve if iGPT-4 has, say, 1050 parameters? Both the wide and the narrow options will be chosen? With which weights?

This market is weird.

@MayMeta GPT-4 recommends weighting by the reciprocal of the interval length.

i.e. The 800-wide entry should get a weight of 1/800 if the answer is in there. A 100-wide entry would get a weight of 1/100, so 8x more.

I also notice that there are answers that overlap with each other @JustinKwong

@NoaNabeshima oops, @JustinTorre

The units for these answers are in B of parameters, right??? @JustinTorre

@NoaNabeshima lmao

If GPT-4 is a MoE model it will probably have >1600B parameters.

Hugging face's 176 Billion parameter model took 3.5 months on 384 top-of-the-line GPUs to train...

Note that HuggingFace's model was trained on 350B tokens. The Chinchilla optimal amount of tokens for a 175B model is 3500B tokens, so 10x as much!

Started one with a numeric answer:

in billions, I assume?

@Nikola Bars (300-350, 350-400, 400-450) seem better for this kind of market, right?

@Nikola Or just a market for a numerical value