Will a LLM trained with FP4 have competitive performance in 2 years time?
16
1kṀ2955
resolved Mar 4
Resolved
NO

"Currently, the technology for 4-bit training does not exists, but research looks promising and I expect the first high performance FP4 Large Language Model (LLM) with competitive predictive performance to be trained in 1-2 years time." (see: https://timdettmers.com/2023/01/16/which-gpu-for-deep-learning/)

Granted, the model must be open source for us to know, so the market will resolve based on publicly available information.

Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ158
2Ṁ152
3Ṁ90
4Ṁ55
5Ṁ33
© Manifold Markets, Inc.TermsPrivacy