Will GPT-4 improve on the Chinchilla scaling law?
90
1.7kṀ8738resolved Jan 2
Resolved
N/A1H
6H
1D
1W
1M
ALL
Currently, the best known scaling law for language models comes from https://arxiv.org/abs/2203.15556 .
This market will resolve YES if OpenAI improve on this scaling law when training GPT-4, ie get better performance (in terms of crossentropy) per training FLOP. It will resolve NO if they get the same performance or worse.
If GPT-4 is multimodal and gets better performance per FLOP on pure language modeling this market resolve YES.
Close date updated to 2023-12-31 5:59 pm
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000People are also trading
Related questions
Will GPT-5 be released incrementally as GPT4.x for different checkpoints from the training run?
4% chance
GPT-4 #5: Will GPT-4 be a dense model?
1% chance
Will GPT-4 escape?
5% chance
Will the performance jump from GPT4->GPT5 be less than the one from GPT3->GPT4?
70% chance
What will the aggregate improvement of GPT5 be over GPT4 in terms of metrics?
157
Will a GPT-4 level system be trained for <$1mm by 2028?
89% chance