Will the largest Llama 3 has > 100B ACTIVE parameters?

Standard

Ṁ5640

resolved Aug 5

Resolved

YES

ALL

In case Llama 3 dynamically adjust the number of active parameters when running, then we resolve to the most number that still makes sense (i.e. with the best performance)

#AI

#LLMs

#Meta (Facebook)

Get

1,000

and

1.00

6 Comments

Sort by:

@mods this seems resolvable assumiing 3.1 counts which I imagine it would?

https://ai.meta.com/blog/meta-llama-3/

will resolve after this comes out

bought Ṁ3,500 YES

@Sss

DanboughtṀ60NO

https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md

@DanMan314 there is more comming

My guess would be 8x70B~=130B active param

Related questions

Related questions