Are Mixture of Expert (MoE) transformer models generally more human interpretable than dense transformers? | Manifold

~deleted~

Are Mixture of Expert (MoE) transformer models generally more human interpretable than dense transformers?

45%

chance

15

Ṁ1kṀ1.3k

Dec 31