Will the largest Llama 3 has > 100B ACTIVE parameters?
AILLMsMeta (Facebook)
Basic
17
Ṁ5.6k
resolved Aug 5
Resolved
YES

In case Llama 3 dynamically adjust the number of active parameters when running, then we resolve to the most number that still makes sense (i.e. with the best performance)

Get Ṁ1,000 play money

Related questions

🏅 Top traders

#NameTotal profit
1Ṁ94
2Ṁ55
3Ṁ35
4Ṁ3
5Ṁ2
6 Comments
14 Holders
28 Trades
Sort by:

@mods this seems resolvable assumiing 3.1 counts which I imagine it would?

https://ai.meta.com/blog/meta-llama-3/

will resolve after this comes out

bought Ṁ3,500 YES

@Sss

DanboughtṀ60NO

https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md

@DanMan314 there is more comming

My guess would be 8x70B~=130B active param

Related questions