What will the inference cost of the best publicly available LM be in 2030?
5
24
แน3922031
1D
1W
1M
ALL
12%
.01-.1 docs
23%
.1-1 docs
26%
1-10 docs
12%
10-100 docs
13%
100-1K docs
2%
1K-10K docs
0.2%
10K-100K docs
4%
.001-.01 docs
Consider the best publicly available language model in 2030. For a single 2023 US dollar, how many 2K word documents can I each generate five words for?
I will pick a somewhat conservative estimate of the best inference cost I can achieve after working for three weeks with whatever funds I have at the time and without using publicly inaccessible resources.
Multimodal models that can operate on text count as LMs for the purpose of this question.
I will only accept answers that range over an OOM like so:
.1-1 docs, 1-10 docs, 10-100 docs
I may trade in this market.
Get แน200 play money
Sort by:
The new ChatGPT model (https://openai.com/blog/introducing-chatgpt-and-whisper-apis) is $.002/1K tokens, so
187 docs/$ = 1/[(2.005 x 1K words/doc)*(4/3 tok/word)*(0.002 $ / 1K tok)]
Related questions
Related questions
Will there be a gpt-4 quality LLM with distributed inference by the end of 2024?
31% chance
Will an opensource LLM on huggingface beat an average human at the most common LLM benchmarks by July 1, 2024?
79% chance
What will be true of Anthropic's best LLM by EOY 2025?
Will an open-source LLM beat or match GPT-4 by the end of 2024?
64% chance
How much FLOP will be used to train the best language model with freely available weights on July 1, 2025?
Will an LLM be able to match the ground truth >85% of the time when performing PII detection by 2024 end?
84% chance
In 2030, will most human-computer interactions happen through a LLM-interface?
24% chance
Will second-order optimizers displace first-order optimizers for training LLMs by 2030?
49% chance
What will be true of OpenAI's best LLM by EOY 2025?
Will Google have a better LLM than OpenAI by 2025?
31% chance