Will Gemini achieve a score above 90% on the MMLU benchmark?

Ṁ410Ṁ2.5k

resolved Dec 6

Resolved

YES

ALL

Considering the performance improvement resulting from progress of prompt engineering, I will have a deadline of 2025/1/1.

Market context

Get

1,000

to start trading!

🏅 Top traders

People are also trading

Sort by:

The exact score is 90.04% - This Question will resolve YES.

@3684 Curious where you found that

Does it have to be one shot?

@glassbottle No. All types of prompts are allowed.

lol

Added this market here because I thought it could be classified as third party validated. https://manifold.markets/group/third-party-validated-predictive-ma-6bab86c0b8b0/questions

pure LLM or anything using Gemini as a submodel?