New METR SOTA by EOY?

3

Ṁ100Ṁ565

resolved Dec 18

Resolved

YES

1H

6H

1D

1W

1M

ALL

Resolves YES if any model surpasses a 50% time-horizon of 2h 42m on https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/ by EOY

Update 2025-12-12 (PST) (AI summary of creator comment): The model must be scored by end of year (not just released by end of year).

Update 2025-12-18 (PST) (AI summary of creator comment): - Creator states that the GPT 5.1 - codex max score qualifies for a YES resolution.

Market context

Get

1,000

to start trading!

🏅 Top traders

#	Trader	Total profit
1		Ṁ69
2		Ṁ11

People are also trading

New METR SOTA by end of January, 2026?

New METR SOTA by end of February, 2026?

SOTA AI at EOY 2026 a reasoning model?

MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?

By what date will at least one SOTA reasoning model use neuralese?

BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?

By what date will all SOTA reasoning models use neuralese?

MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?

Is attention all you need? (transformers SOTA in 2027)

[Carlini questions] Cost of single SOTA AI system training run by 2027

Sort by:

bought Ṁ300 YES

@creator updated data is out; GPT 5.1 - codex max is now 2 hours 53 minutes

may seem like a cheap win but per the market terms I think it qualifies.

@MRME yeah could go either way on this one but YES resolution seems best given the wording of the question and description

Does it have to be scored by the end of the year or does the model have to be released by the end of the year

@BenAybar scored

People are also trading

New METR SOTA by end of January, 2026?

-44% 1d6% chance

New METR SOTA by end of February, 2026?

-25% 1d25% chance

SOTA AI at EOY 2026 a reasoning model?

MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?

By what date will at least one SOTA reasoning model use neuralese?

BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?

By what date will all SOTA reasoning models use neuralese?

MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?

Is attention all you need? (transformers SOTA in 2027)

[Carlini questions] Cost of single SOTA AI system training run by 2027

Related questions

New METR SOTA by end of January, 2026?

New METR SOTA by end of February, 2026?

SOTA AI at EOY 2026 a reasoning model?

MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?

By what date will at least one SOTA reasoning model use neuralese?

BIG-bench accuracy 75% #5: Will SOTA for a single model on BIG-bench pass 75% by the start of 2028?

By what date will all SOTA reasoning models use neuralese?

MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?

Is attention all you need? (transformers SOTA in 2027)

[Carlini questions] Cost of single SOTA AI system training run by 2027

© Manifold Markets, Inc.•Terms•Privacy