Will Gemini Ultra beat GPT-4V on the REBUS benchmark?
11
116
230
Jul 10
17%
chance

Resolves YES if someone with access to Gemini Ultra runs it on the REBUS evaluation benchmark using the same methodology and it gets a higher percentage of the rebus answers correct than GPT-4V (24%). N/A if no one gets access to the model by the market close.

Get Ṁ200 play money
Sort by:
bought Ṁ0 of YES

on MMMU, Gemini Ultra seems to be outperforming GPT-4V:

More related questions