Will Gemini Ultra beat GPT-4V on the REBUS benchmark?
11
116
Ṁ602Ṁ230
Jul 10
17%
chance
1D
1W
1M
ALL
Resolves YES if someone with access to Gemini Ultra runs it on the REBUS evaluation benchmark using the same methodology and it gets a higher percentage of the rebus answers correct than GPT-4V (24%). N/A if no one gets access to the model by the market close.
Get Ṁ600 play money
Related questions
Will Google's Gemini beat GPT4 in terms of capabilities on release?
22% chance
Will Gemini achieve a higher score on the SAT compared to GPT-4?
69% chance
Will Google Gemini perform better (text) than GPT-4?
35% chance
Will an open source model beat GPT-4 in 2024?
62% chance
Will Gemini outperform GPT-4 at mathematical theorem-proving?
56% chance
Will Gemini Ultra outperform GPT-4V on visual reasoning by the end of 2024?
65% chance
Will Gemini 1.5 Pro seem to be as good as Gemini 1.0 Ultra for common use cases? [Personal judgement]
57% chance
Will "Gemini [Ultra, 1.0] smash GPT-4 by 5x"?
19% chance
Will Gemini exceed the performance of GPT-4 on the 2022 AMC 10 and AMC 12 exams?
69% chance
Will Google Gemini do as well as GPT-4 on Sparks of AGI tasks?
76% chance