Will second-order optimizers displace first-order optimizers for training LLMs by 2030?
20
140
Ṁ1.1KṀ370
2029
49%
chance
1D
1W
1M
ALL
Will something like Shampoo become the default instead of Adam?
Get Ṁ200 play money
More related questions
Related questions
Will Google have a better LLM than OpenAI by 2025?
35% chance
Will Europe be competitive in the LLM race compared to OpenAI and Google at the end of 2024?
31% chance
By 2025 end, will it be generally agreed upon that LLM produced text/code > human text/code for training LLMs?
25% chance
Will a LLM beat human experts on GPQA by Jan 1, 2025?
70% chance
Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?
45% chance
Will reinforcement learning overtake LMs on math before 2028?
43% chance
Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?
48% chance
Will Mamba be the de-facto paradigm for LLMs over transformers by 2025?
25% chance
Will an an LLM be able to pass something equivalent to Yann LeCun's 7-gear test by the end of 2024?
71% chance
Will Nonlinear exist in 2030?
36% chance