What exactly will xAI open source, when they "open source" their AI language model "Grok" ?
31
348
1.6K
Dec 31
27%
A research paper about Grok
26%
Grok's results on the standard benchmarks
19%
Some statistics on data distribution for training Grok
Resolved
N/A
All the model weights

For the purpose of this market, we will not argue about the definition of open source.

Get Ṁ200 play money
Sort by:

We now support unresolving/re-resolving markets of this format. Please let me know which answers need amending!

(or u can just do it yourself @firstuserhere )

@SirSalty Awesome, thank you!

@SirSalty I dont see the option , can you resolve "All the model weights" to N/A?

1 or 2 options were ambiguous and I should reresolve them to N/A - but maybe the current market format doesnt allow that - in which case lemme see whether an admin can , and if not , then i'll create a new market to fix the profits.

@firstuserhere Are you trying to resolve this? This is the biggest loss I've had on this site. I looked at the website and it said:

March 17, 2024

Open Release of Grok-1

We are releasing the weights and architecture of our 314 billion parameter Mixture-of-Experts model, Grok-1.

So I put a lot on it, thinking it was a sure thing. 😣

Different checkpoints captured during model training

These are in the torrents and used by the code in the git repo.

All the model weights

This should have resolved to yes: https://x.ai/blog/grok-os

It clearly says the weights are released and there is a link to them.

@Magnus_ All the model weights are not released, only some of them

@firstuserhere Then this should be NA as most of us here can’t really understand that “the weights” you refer to is different from gross definition of “the weights”

@Magnus_ That's fair enough too, I am trying to figure out how to re-resolve it as N/A

@firstuserhere Are you going to change the resolution?

All the model weights

Why did this resolve no?

@aranku See my comment below. I would actually not have known how to resolve it myself.

@HarrisonNathan Yeah that's a fair line of reasoning

bought Ṁ20 The source code to t... NO

@RS yes gonna go through the post and reoslve in a bit

@firstuserhere There's a fair amount of ambiguity in "all the model weights."

Text is:
"We are releasing the base model weights and network architecture of Grok-1, our large language model. Grok-1 is a 314 billion parameter Mixture-of-Experts model trained from scratch by xAI.

This is the raw base model checkpoint from the Grok-1 pre-training phase, which concluded in October 2023. This means that the model is not fine-tuned for any specific application, such as dialogue."

So they did not release all the model weights of Grok, but they did release all the model weights of a pre-training phase of Grok.

@HarrisonNathan That should resolve to YES, then; it's not ambiguous.

@Snarflak I would actually tend to think 'no' is a better resolution, as the question referred to "Grok" with quotes, and we got the model weights of "the raw base model checkpoint from the Grok-1 pre-training phase." What's your reasoning?

@HarrisonNathan You think Grok-1 is not Grok? o_O

@HarrisonNathan From the website:

March 17, 2024

Open Release of Grok-1

We are releasing the weights and architecture of our 314 billion parameter Mixture-of-Experts model, Grok-1.

bought Ṁ50 Grok's results on th... YES

Can you clarify when you will resolve? Eg if some event hits a threshold, will you resolve everything at that point vs wait til end of year?

@Tyler31 its under the assumption they release it soon, if it's mid April and still nothing, I'll resolve all to N/A

Edit: this originally said NO but thinking about it, N/A makes sense.

eh, I think it should be N/A instead so the prices aren't all derivatives of 'will it open source'

@jacksonpolack yeah fair enough. Added an option to use as a hedge

More related questions