Will second-order optimizers displace first-order optimizers for training LLMs by 2030?
13
closes 2029
56%
chance

Will something like Shampoo become the default instead of Adam?

Sort by:
MichaelLucy avatar
Michael Lucybought Ṁ10 of NO

Seems possible but <50%? Why do you think it's so high?

Related markets

Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?57%
Will LLM training costs fall 300x by 2028?84%
Will Google have a better LLM than OpenAI by 2025?41%
Will LLM training costs fall 100x by 2028?90%
Will LLM training costs fall 100x by 2028?84%
Will LLMs (or similar AI systems) be meaningfully integrated into US public school education by 2025?7%
By 2027, will it be generally agreed upon that LLM produced text > human text for training LLMs?45%
Will LLM training costs fall 1,000x by 2028?75%
Will there exist popular smart glasses with LLM integration by 2030?68%
Will LLMs be better than typical white-collar workers on all computer tasks before 2026?42%
Will LLM Detection Get Better By The End of 2023?47%
By 2025 end, will it be generally agreed upon that LLM produced text/code > human text/code for training LLMs?40%
In 2023, will there be a "trough of disillusionment" regarding LLMs?13%
What will the inference cost of the best publicly available LM be in 2030?
By 2029 end, will it be generally agreed upon that LLM produced text/code > human text/code for training LLMs?70%
Will LLMs become a ubiquitous part of everyday life by June 2026?90%
Will any company form a defensible moat around LLM-based AI before 2025?22%
In 2030, will LLMs be sending messages to coordinate with one another, whether we can decode them or not?62%
Will a major technology company publicly admit to using a LLM for important decision making before 2025?23%
Will a LLM considerably more powerful than GPT-4 come out in 2023?23%