Will OpenAI release a tokenizer with more than 210000 tokens before 2026?
1
102Ṁ792026
24%
chance
1D
1W
1M
ALL
Resolves YES if OpenAI adds support for a tokenizer with more than 210000 tokens to tiktoken (or its successor) before 2026.
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000Related questions
Related questions
Will OpenAI release a tokenizer with vocab size > 150k by end of 2024?
42% chance
Will OpenAI reveal a textless LLM before 2025?
4% chance
Will the next major LLM by OpenAI use a new tokenizer?
77% chance
Will OpenAI release a version of Voice Engine by the end of 2024?
81% chance
Will OpenAI reveal thinking tokens by the end of June 2025?
61% chance
Will a flagship (>60T training bytes) open-weights LLM from Meta which doesn't use a tokenizer be released in 2025?
29% chance
Will OpenAI fold in 2025?
3% chance
Will OpenAI have a new name by the end of 2025?
13% chance
Will OpenAI exist in Jan 2027?
81% chance
Will OpenAI disappear before 2034?
34% chance