Will OpenAI release a tokenizer with vocab size > 150k by end of 2024?
Basic
8
Ṁ90Dec 31
42%
chance
1D
1W
1M
ALL
The GPT-2 model used r50k_base: vocab size = 50k
The GPT-3 model used r50k_base: vocab size = 50k
The GPT-3.5 model used cl100k_base: vocab size = 100k
The GPT-4 model used cl100k_base: vocab size = 100k
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Will OpenAI release a tokenizer with more than 210000 tokens before 2026?
24% chance
Will there be an AI language model that strongly surpasses ChatGPT and other OpenAI models before the end of 2024?
13% chance
Will a OpenAI model have over 500k token capacity by the end of 2024.
50% chance
Will the next major LLM by OpenAI use a new tokenizer?
76% chance
Will OpenAI release their o1 model before 2025?
95% chance
Will OpenAI release an AI product with a cool name by Jan 1, 2025?
25% chance
Will OpenAI release a version of Voice Engine by the end of 2024?
81% chance
Will OpenAI release o2 before 2026?
81% chance
Will OpenAI release GPT-5 before the end of 2024?
8% chance
Will OpenAI release a product with stateful AI agents by 2025?
80% chance