Are Mixture of Expert (MoE) transformer models generally more human interpretable than dense transformers? | Manifold

~deleted~

Are Mixture of Expert (MoE) transformer models generally more human interpretable than dense transformers?

45%

chance

15

1kṀ1318

Dec 31