By the start of 2026, will I still think that transformers are the main architecture for tasks related to natural language processing?
3
25
Ṁ30Ṁ110
2025
68%
chance
1D
1W
1M
ALL
My job is related to NLP, and I expect I will be able to judge the position on transformers in the field. No specific criteria, sorry, the question is just about my opinion.
Get Ṁ200 play money
Related questions
Sort by:
@NathanHelmBurger I wonder if we can pin down specific predictions about what we believe will or won't change, then
@wadimiusz yeah, unclear. RWKV and Hyena seem like promising advances. As the large labs start getting more cagey about their exact techniques we might not even know which techniques they are using.
https://hazyresearch.stanford.edu/blog/2023-03-27-long-learning
More related questions
Related questions
By the end of 2026, will we have transparency into any useful internal pattern within a Large Language Model whose semantics would have been unfamiliar to AI and cognitive science in 2006?
53% chance
By EOY 2026, will it seem as if deep learning hit a wall by EOY 2025?
36% chance
Will superposition in transformers be mostly solved by 2026?
57% chance
Will Transformer based architectures still be SOTA for language modelling by 2026?
67% chance
Will natural language based proof assistants be in common use by 2026?
36% chance
Will transformers still be the dominant DL architecture in 2026?
59% chance
Will more people interact with AI via voice than via text at the end of 2027?
50% chance
🐕 Will A.I. Achieve Significantly More, "Linguistic Temporal Understanding" by end of 2024?
36% chance
Will Scaling Laws for Neural Language Model continue to hold till the end of 2027?
65% chance
Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?
44% chance