Do you think Mixture of Expert (MoE) transformer models are generally more human interpretable than dense transformers?
Do you think Mixture of Expert (MoE) transformer models are generally more human interpretable than dense transformers?
15
Never closes
Yes
No
Results
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000What is this?
What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Or create your own play-money betting market on any question you care about.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like betting still use Manifold to get reliable news.
Why use play money?
Why use play money?Mana (Ṁ) is the play-money currency used to bet on Manifold. It cannot be converted to cash. All users start with Ṁ1,000 for free.
Play money means it's much easier for anyone anywhere in the world to get started and try out forecasting without any risk. It also means there's more freedom to create and bet on any type of question.
People are also trading
What is this?
What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Or create your own play-money betting market on any question you care about.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like betting still use Manifold to get reliable news.
Why use play money?
Why use play money?Mana (Ṁ) is the play-money currency used to bet on Manifold. It cannot be converted to cash. All users start with Ṁ1,000 for free.
Play money means it's much easier for anyone anywhere in the world to get started and try out forecasting without any risk. It also means there's more freedom to create and bet on any type of question.
Related questions
Are Mixture of Expert (MoE) transformer models generally more human interpretable than dense transformers?
45% chance
Is gpt-3.5-turbo a Mixture of Experts (MoE)?
84% chance
Will mechanistic/transformer interpretability [eg Neel Nanda] end up affecting p(doom) more than 5%?
10% chance
Will the most capable, public multimodal model at the end of 2027 in my judgement use a transformer-like architecture?
63% chance
By EOY 2025, will the model with the lowest perplexity on Common Crawl will not be based on transformers?
10% chance
Before Feb 2026, will a transformer based reasoning model >1800 elo be able to explain 3+ chess lines at any position?
53% chance
Will Transformer based architectures still be SOTA for language modelling by 2026?
80% chance