Are Mixture of Expert (MoE) transformer models generally more human interpretable than dense transformers? | Manifold

~deleted~

Are Mixture of Expert (MoE) transformer models generally more human interpretable than dense transformers?

50%

chance

Plus

14

Ṁ1218

2025