Will the largest Llama 3 has > 100B ACTIVE parameters?

Plus

Ṁ5640

resolved Aug 5

Resolved

YES

ALL

In case Llama 3 dynamically adjust the number of active parameters when running, then we resolve to the most number that still makes sense (i.e. with the best performance)

This question is managed and resolved by Manifold.

#AI

#LLMs

#Meta (Facebook)

Get

1,000

and

3.00

6 Comments

14 Holders

28 Trades

Sort by:

@mods this seems resolvable assumiing 3.1 counts which I imagine it would?

https://ai.meta.com/blog/meta-llama-3/

will resolve after this comes out

bought Ṁ3,500 YES

@Sss

DanboughtṀ60NO

https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md

@DanMan314 there is more comming

My guess would be 8x70B~=130B active param

Related questions

Related questions