Will AI image generating models score >= 90% on Winoground by June 1, 2025?

30

1kṀ2732

resolved Jun 2

Resolved

NO

1H

6H

1D

1W

1M

ALL

Based on the recent discussions between Gary Marcus and @ScottAlexander, this market resolves as follows:

IF any AI image generating model (such as DALL-E, Imagen, Stable Diffusion, etc) scores 90% or more on the Winoground image composition test, this market resolves YES.

ELSE this market resolves NO.

Relevant Links:
Scott's post: https://astralcodexten.substack.com/p/i-won-my-three-year-ai-progress-bet
Gary's post: https://garymarcus.substack.com/p/did-googleai-just-snooker-one-of
Winoground: https://arxiv.org/pdf/2204.03162v2.pdf

Market context

Get

1,000

to start trading!

🏅 Top traders

#	Name	Total profit
1		Ṁ538
2		Ṁ305
3		Ṁ216
4		Ṁ116
5		Ṁ99

People are also trading

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?

Will a publicly known AI model achieve an 80% time horizon that is an 1 hour and 30 minutes by September 2026?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

AI generates better alt text for 90% of test images by June 30, 2026?

Google releases an AI world model game by June 1st 2026?

In what year will AI achieve a score of 95% or higher on the GPQA benchmark?

In what year will AI achieve a score of 95% or higher on the GSO benchmark?

In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?

Will AI pass the Winograd schema challenge by the end of 2030?

Sort by:

Looks like Manifold was too bullish!

bought Ṁ600 NO

@SneakySly Resolves NO

https://paperswithcode.com/sota/visual-reasoning-on-winoground

Best results seem to be around 75 %

This market's resolution seems pretty dependent on whether someone runs the benchmark with current frontier models

I like this question, thank you!

People are also trading

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

+4% 1d65% chance

Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?

Will a publicly known AI model achieve an 80% time horizon that is an 1 hour and 30 minutes by September 2026?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

AI generates better alt text for 90% of test images by June 30, 2026?

Google releases an AI world model game by June 1st 2026?

In what year will AI achieve a score of 95% or higher on the GPQA benchmark?

In what year will AI achieve a score of 95% or higher on the GSO benchmark?

In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?

Will AI pass the Winograd schema challenge by the end of 2030?

Related questions

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?

Will a publicly known AI model achieve an 80% time horizon that is an 1 hour and 30 minutes by September 2026?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

AI generates better alt text for 90% of test images by June 30, 2026?

Google releases an AI world model game by June 1st 2026?

In what year will AI achieve a score of 95% or higher on the GPQA benchmark?

In what year will AI achieve a score of 95% or higher on the GSO benchmark?

In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?

Will AI pass the Winograd schema challenge by the end of 2030?

© Manifold Markets, Inc.•Terms•Privacy