What will be true of Gemini 2?
Basic
19
Ṁ12132027
99%
It will be released in 2024
99%
It will be released before GPT-5
76%
It will score >70% on GPQA (diamond, pass@1)
72%
>20% (5-shot) on SWEBench (current sota ~ 6%?)
59%
It will get into at least one PR blunder, like the woke issue for Gemini 1 Ultra
58%
It will score better than o1-preview at AIME (44.6% in single pass)
54%
It (the strongest variant) will be better than the best OpenAI model at the moment of release
52%
It will score >= 85% on MMLU Pro
47%
It will score >=80% on MMMU
31%
It has input modalities other than text, audio, and video (MIDI/code count as text)
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
huh, not sure how the benchmark questions should resolve now that 2.0 Flash is out. Maybe wait for info on 2.0 pro? Also relevant that it is called "2.0 Flash Experimental" for now
Related questions
Related questions
Is the model Gemini Experimental 1206 an early version of what will be Gemini 2 Pro?
82% chance
Will Gemini achieve a higher score on the SAT compared to GPT-4?
70% chance
Will Gemini 1.5 Pro seem to be as good as Gemini 1.0 Ultra for common use cases? [Poll]
70% chance
Will Gemini exceed the performance of GPT-4 on the 2022 AMC 10 and AMC 12 exams?
72% chance
Will Gemini be released before 2024? x Will GPT-5 be released before 2025?
Will any Gemini astronauts die in 2024?
24% chance
Will Google release a model called Gemini 1.5 Ultra or Gemini 2.0 Ultra before the end of the year?
4% chance
Will Gemini be more popular than Chatgpt at the end of 2027?
48% chance
Will Gemini be more popular than Chatgpt at the end of 2024?
7% chance
Will Gemini be more popular than Chatgpt at the end of 2026?
36% chance