Will the largest Llama 3 have> 500B TOTAL parameters?
27
162
1k
2025
6%
chance

For MoE, it is much harder to determine the total parameters than active parameters. bet with caution

Get Ṁ600 play money
Sort by:

I probably should not set the bar to 500B. Coz if it turns out to be 8x70B, the judgement will be hard to make.

More related questions