Will AI image generating models score >= 90% on Winoground by June 1, 2025?
Plus
20
Ṁ8402025
81%
chance
1D
1W
1M
ALL
Based on the recent discussions between Gary Marcus and @ScottAlexander, this market resolves as follows:
IF any AI image generating model (such as DALL-E, Imagen, Stable Diffusion, etc) scores 90% or more on the Winoground image composition test, this market resolves YES.
ELSE this market resolves NO.
Relevant Links:
Scott's post: https://astralcodexten.substack.com/p/i-won-my-three-year-ai-progress-bet
Gary's post: https://garymarcus.substack.com/p/did-googleai-just-snooker-one-of
Winoground: https://arxiv.org/pdf/2204.03162v2.pdf
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Will AI pass the Longbets version of the Turing test by the end of 2029?
57% chance
Will AI be able to generate correct images of a chess game in 2024?
25% chance
Will any model get above human level (92%) on the Simple Bench benchmark before September 1st, 2025.
36% chance
Will there be a model that has a 75% win rate against the latest iteration of GPT-4 as of January 1st, 2025?
62% chance
Will AI pass the Winograd schema challenge by the end of 2024?
66% chance
Will an AI agent system be able to score at least 40% on level 3 tasks in the GAIA benchmark before 2025.
48% chance
Will open-source AI win (through 2025)?
33% chance
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
56% chance
Will a new lab create a top-performing AI frontier model before 2028?
57% chance
Will OpenAI models achieve ≥90% on SimpleBench by the end of 2025?
38% chance