Is attention all you need? (transformers SOTA in 2027)
111
1.3K
Ṁ19KṀ3.6K
2027
45%
chance
1D
1W
1M
ALL
This market simulates the wager between Jonathan Frankie (@jefrankle) and Sasha Rush (@srush_nlp)
Details can be fount at https://www.isattentionallyouneed.com/
Proposition
On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmarked tasks in natural language processing.
Other markets on the same:
Get Ṁ200 play money
Related questions
Sort by:
predicts YES
@EchoNolan I talked to Sasha, and his response is basically that as long as the E in the MoE is Transformer, its a transformer.
@jacksonpolack Hm, I will add in subsidy at a later point wherever the market stabilizes to maintain that
More related questions
Mechanistic interpretability questions
By the end of 2026, will we have transparency into any useful internal pattern within a Large Language Model whose semantics would have been unfamiliar to AI and cognitive science in 2006?
50% chance
Do scaling laws happen because models experience a ton of tiny phase changes which average out to a smooth curve?
48% chance
Related questions
On January 1, 2027, a Transformer-like model will continue to hold the state-of-the-art position in most benchmark
38% chance
Ford F-150 dethroned as the top selling car in the United States before 2030
69% chance
Ford F-150 dethroned as the top selling car in the United States before 2028
56% chance
Tesla introduces model which can be configured to have >=500 mile range per charge before 2029
63% chance
Tesla's market cap is higher than Bitcoin's on January 1st, 2025
23% chance
Will Transformer based architectures still be SOTA for language modelling by 2026?
67% chance
Tesla will deliver more Cybertrucks than Model Xs in 2024
88% chance
By Jan 1, 2029, an electric car will be available in the US w/ a range over 1000 miles for <$75K (inflation adjusted)
46% chance
The price of $TSLA on January 1st 2025.
Will transformers still be the dominant DL architecture in 2026?
57% chance