![](/_next/image?url=https%3A%2F%2Ffirebasestorage.googleapis.com%2Fv0%2Fb%2Fmantic-markets.appspot.com%2Fo%2Fdream%252FOPyHHn9tdA.png%3Falt%3Dmedia%26token%3Df09475e2-90aa-475e-ae12-7f9a75f59262&w=3840&q=75)
Will second-order optimizers displace first-order optimizers for training LLMs by 2030?
Basic
24
Ṁ1.7k2029
38%
chance
1D
1W
1M
ALL
Will something like Shampoo become the default instead of Adam?
Get Ṁ600 play money
Related questions
Related questions
Will LLMs be better than typical white-collar workers on all computer tasks before 2026?
33% chance
Will Google have a better LLM than OpenAI by 2025?
31% chance
Will LLMs mostly overcome the Reversal Curse by the end of 2025?
62% chance
Will reinforcement learning overtake LMs on math before 2028?
57% chance
Will a LLM beat human experts on GPQA by Jan 1, 2025?
53% chance
Will the best public LLM at the end of 2025 solve more than 5 of the first 10 Project Euler problems published in 2026?
44% chance
LLMs widely used in economics modeling by the end of 2026?
43% chance
Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?
58% chance
By 2028 will we be able to identify distinct submodules/algorithms within LLMs?
75% chance
Will Europe be competitive in the LLM race compared to OpenAI or Google at the end of 2024?
17% chance