Will Gemini achieve a score above 90% on the MMLU benchmark?
21
410Ṁ2517
resolved Dec 6
Resolved
YES

Considering the performance improvement resulting from progress of prompt engineering, I will have a deadline of 2025/1/1.

AI
Google Gemini
Third Party Validated, Predictive Markets: AI
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ126
2Ṁ78
3Ṁ31
4Ṁ21
5Ṁ14

People are also trading

Sort by:

The exact score is 90.04% - This Question will resolve YES.

@3684 Curious where you found that

Does it have to be one shot?

@glassbottle No. All types of prompts are allowed.

lol

Added this market here because I thought it could be classified as third party validated. https://manifold.markets/group/third-party-validated-predictive-ma-6bab86c0b8b0/questions

Third Party Validated, Predictive Markets: AI
Manifold curated group with 2 members

pure LLM or anything using Gemini as a submodel?

@NikhilVyas pure LLM

People are also trading

© Manifold Markets, Inc.•Terms•Privacy