Will there be an LLM (as good as GPT-4) that was trained with 1/10th the energy consumed to train GPT-4, by 2026? | Manifold

Will there be an LLM (as good as GPT-4) that was trained with 1/10th the energy consumed to train GPT-4, by 2026?

Plus

22

Ṁ1270

2026

85%

chance

1D

1W

1M

ALL

The total power consumption could be estimated to be around 50-60 million kWh for training GPT-4.

1/10th of this energy = 5-6 million kWh

1/100th of this energy = 0.5-0.6 million kWh

See calculations below:

This question is managed and resolved by Manifold.

#Technical AI Timelines

#GPT-4 speculation

Get

1,000

and

3.00

Sort by:

bought Ṁ500 YES

Jensen Huang (CEO of NVIDIA) said that with Blackwell GPUs, you could train GPT-4 with only about 4 MW of power consumed. Looks like even without algorithmic improvements we can get there.

Approx 4x efficiency improvement from silicon alone, based on latest GPUs being announced now (specifically mi300x Vs a100).

Related questions

Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?

Will there be an open source LLM as good as GPT4 by the end of 2024?

Will there be a OpenAI LLM known as GPT-4.5? by 2033

Will a 15 billion parameter LLM match or outperform GPT4 in 2024?

Will xAI develop a more capable LLM than GPT-5 by 2026

Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?

Will there be an open source LLM as good as GPT4 by June 2024?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Which next-gen frontier LLMs will be released before GPT-5? (2025)

Will a language model comparable to GPT-4 be trained, with ~1/10th the amount of energy it took train GPT-4, by 2028?

Related questions

Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?

Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?

Will there be an open source LLM as good as GPT4 by the end of 2024?

Will there be an open source LLM as good as GPT4 by June 2024?

Will there be a OpenAI LLM known as GPT-4.5? by 2033

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will a 15 billion parameter LLM match or outperform GPT4 in 2024?

Which next-gen frontier LLMs will be released before GPT-5? (2025)

Will xAI develop a more capable LLM than GPT-5 by 2026

Will a language model comparable to GPT-4 be trained, with ~1/10th the amount of energy it took train GPT-4, by 2028?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules