an LLM as capable as GPT-4 runs on one 3090 by March 2025 | Manifold

an LLM as capable as GPT-4 runs on one 3090 by March 2025

Plus

26

Ṁ1640

Mar 2

30%

chance

1D

1W

1M

ALL

e.g. Winograde >= 87.5%

This question is managed and resolved by Manifold.

Get

1,000

and

3.00

Sort by:

I imagine the weights need to fit in VRAM; does that sound right? Or can the solution involve moving weights on/off the GPU

@NoaNabeshima weights have to fit in vram

@sylv ram and not necessarily vram?

*vram sorry

predicts YES

new market for 4090: https://manifold.markets/sylv/an-llm-as-capable-as-gpt4-runs-on-o-8da33ccbe4b1

bought Ṁ80 NO

@sylv The difference between the 3090 market and the 4090 market is because.. the 4090 supports fp8??

@NoaNabeshima I mean it has better specs in general but fp8 is pretty cool

@NoaNabeshima Oh it's different dates

Related questions

an LLM as capable as GPT-4 runs on one 4090 by March 2025

Will there be an open source LLM as good as GPT4 by June 2024?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will xAI develop a more capable LLM than GPT-5 by 2026

Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?

Will there be an open source LLM as good as GPT4 by the end of 2024?

Will a 15 billion parameter LLM match or outperform GPT4 in 2024?

Which next-gen frontier LLMs will be released before GPT-5? (2025)

Will there be a OpenAI LLM known as GPT-4.5? by 2033

Will it be possible to run an LLM of GPT-4 (or higher) capability on a portable device by 2027?

Related questions

an LLM as capable as GPT-4 runs on one 4090 by March 2025

Will there be an open source LLM as good as GPT4 by the end of 2024?

Will there be an open source LLM as good as GPT4 by June 2024?

Will a 15 billion parameter LLM match or outperform GPT4 in 2024?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Which next-gen frontier LLMs will be released before GPT-5? (2025)

Will xAI develop a more capable LLM than GPT-5 by 2026

Will there be a OpenAI LLM known as GPT-4.5? by 2033

Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?

Will it be possible to run an LLM of GPT-4 (or higher) capability on a portable device by 2027?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules