In what year will a GPT4-equivalent model be able to run on consumer hardware?
6
closes 2051
2024
expected

"Consumer hardware" is defined as costing no more than $3,000 USD for everything that goes inside the case (not including peripherals).

In terms of "GPT4-equivalent model," I'll go with whatever popular consensus seems to indicate the top benchmarks (up to three) are regarding performance. The performance metrics should be within 10% of GPT4's. In the absence of suitable benchmarks I'll make an educated guess come resolution time after consulting educated experts on the subject.

All that's necessary is for the model to run inference, and it doesn't matter how long it takes to generate output so long as you can type in a prompt and get a reply in less than 24 hours. So in the case GPT4's weights are released and someone is able to shrink that model down to run on consumer hardware and get any output at all in less than a day, and the performance of the output meets benchmarks, this resolves to whatever year that first happens in.

Sort by:
mayajalen avatar
maya jalenbought Ṁ10 of LOWER

I think this is already true given the weights being released

LarsDoucet avatar
Lars Doucet

@mayajalen Link me to something convincing?

Related markets

In what year will a GPT4-equivalent model be able to run on consumer hardware?2025
Will a GPT4-equivalent model be able to run on consumer hardware before 2024?29%
Will a large GPT-4 equivalent competitor model be revealed by the end of 2023?52%
Will we have a FOSS GPT-4 Equivalent by the end of the year?15%
Will we have an open-source model that is equivalent GPT-4 by end of 2025?82%
Will a version of GPT-4 finetuned for code be released this year?78%
Will we have a FOSS equivalent of GPT-4 by the end of the year?12%
Will I be able to use GPT4 to work with images by the end of the year?61%
Will GPT-4 be public during 2023?88%
Will a GPT-4 quality model be trained for under $10.000 by 2030?78%
Will GPT-4's parameter count be known by end of 2024?41%
Will I be able to use base GPT-4 at any time in 2023?28%
(M20000 subsidy!) Will a prompt that enables GPT-4 to solve easy Sudoku puzzles be found? (2023)43%
Is GPT-4 best? (2023)74%
GPT-4 performance and compute efficiency from a simple architecture before 202634%
Will GPT-4's parameter count be announced by the end of 2023?5%
Is GPT-4 best? (Thru 2025)26%
Will GPT-4 be the most searched model of 2023?16%
Will a GPT-4 level system be trained for <$1mm by 2028?82%
Will GPT 4.5 be announced by October? (2023)32%