Will transformers still be the dominant DL architecture in 2026?
19
76
แน1Kแน376
2026
57%
chance
1D
1W
1M
ALL
Resolves true if I judge, based on the common opinion among deep learning researchers, that transformers remain the most popular architecture in deep learning research at the start of 2026. If the answer is not clear, resolves true if at least 50% of arXiv papers from 2025 on A.I. mention transformers, otherwise resolves false.
Get แน200 play money
Sort by:
Apparently there is already a very similar market!
https://manifold.markets/LeoGao/will-transformer-based-architecture
More related questions
Related questions
Will the Transformer still be the Dominant AI architecture by mid 2024?
94% chance
Will a new deep learning paradigm replace the transformer by the end of 2024?
18% chance
By the start of 2026, will I still think that transformers are the main architecture for tasks related to natural language processing?
68% chance
In 2026, will it be apparent deep learning hit a non-transient wall at some point in 2023-2025?
25% chance
Will we see most new language models shifting to addition-only architectures like BitNet/BitNet 1.58b in 2024?
55% chance
Will Etched.AI launch a transformer chip product before 2025?
10% chance
Will we find tree search in a vanilla transformer trained on chess games by 2026?
22% chance
Will Scaling Laws for Neural Language Model continue to hold till the end of 2026?
85% chance
Will at least one major player divest* fully from proprietary AI and pivot to fusion research/infrastructure by 2026?
25% chance
Will a transformer based model be SOTA for video generation by the end of 2025?
77% chance