On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark
41
1kṀ57102026
84%
chance
1H
6H
1D
1W
1M
ALL
Tracking external bet: https://www.isattentionallyouneed.com/
This will resolve according to that site, whatever the conditions and caveats they have agreed on.
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000People are also trading
Related questions
Will transformers still be the dominant DL architecture in 2026?
81% chance
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
42% chance
Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?
63% chance
Will Transformer based architectures still be SOTA for language modelling by 2026?
80% chance
On LMSys, what will be the difference between the top model and GPT-4-1106 on Jan 1 2026?
By EOY 2025, will the model with the lowest perplexity on Common Crawl will not be based on transformers?
10% chance
Will superposition in transformers be mostly solved by 2026?
73% chance
When will a non-Transformer model become the top open source LLM?
By the start of 2026, will I still think that transformers are the main architecture for tasks related to natural language processing?
75% chance
Will Optimus be used on the Optimus assembly line before the end of 2025?
20% chance