xAI Grok will beat OpenAI's flagship model on HumanEval benchmarks by the end of 2024.
101
1.1kṀ14k
resolved Jun 9
Resolved
NO

This is inclusive of any new models OpenAI unveils in 2024, but the question resolves to "yes" if Grok beats OpenAI at any time in 2024 against their current state of the art model.

Technical AI Timelines
OpenAI
XAI
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ538
2Ṁ124
3Ṁ72
4Ṁ50
5Ṁ45

People are also trading

Sort by:

@mods resolves NO

@mods Can this be resolved NO?

Dan boughtṀ150YES

https://x.ai/blog/grok-1.5

They claim to have done it:

@DanMan314 67.0% is the HumanEval figure from the original GPT-4 report published more than a year ago. The current zero-shot GPT-4 performance, as reported by Papers With Code, is 76.5%, which is from Guo et al. (January 2024).

Note that the market creator is banned, so this will probably be resolved by moderators. Personally, I think the current version of GPT-4 is the more natural interpretation of "OpenAI's flagship model" than the original version of GPT-4.

Dan soldṀ212YES

@Jacy Yea I just looked into it and I agree with your assessment.

People are also trading

© Manifold Markets, Inc.•Terms•Privacy