Will second-order optimizers displace first-order optimizers for training LLMs by 2030? | Manifold

Will second-order optimizers displace first-order optimizers for training LLMs by 2030?

27

1kṀ2170

2029

43%

chance

1H

6H

1D

1W

1M

ALL

Will something like Shampoo become the default instead of Adam?

Get

1,000

to start trading!

People are also trading

Will Transformer-Based LLMs Make Up ≥75% of Parameters in the Top General AI by 2030?

-5% 1d45% chance

Will RL work for LLMs "spill over" to the rest of RL by 2026?

Will LLMs mostly overcome the Reversal Curse by the end of 2025?

Will "large reasoning models" significantly outperform traditional LLMs in creative writing by 2026?

Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?

Will LLM training costs fall 100x by 2028?

Will LLM training costs fall 100x by 2028?

Will the best LLM in 2025 have <1 trillion parameters?

Will LLM training costs fall 300x by 2028?

Will the best public LLM at the end of 2025 solve more than 5 of the first 10 Project Euler problems published in 2026?

Related questions

Will Transformer-Based LLMs Make Up ≥75% of Parameters in the Top General AI by 2030?

Will RL work for LLMs "spill over" to the rest of RL by 2026?

Will LLMs mostly overcome the Reversal Curse by the end of 2025?

Will "large reasoning models" significantly outperform traditional LLMs in creative writing by 2026?

Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?

Will LLM training costs fall 100x by 2028?

Will LLM training costs fall 100x by 2028?

Will the best LLM in 2025 have <1 trillion parameters?

Will LLM training costs fall 300x by 2028?

Will the best public LLM at the end of 2025 solve more than 5 of the first 10 Project Euler problems published in 2026?

© Manifold Markets, Inc.•Terms•Privacy