Will a hierarchical RL algorithm be SOTA on any major RL benchmark by 2025?

6

180Ṁ88

resolved Jan 9

Resolved

NO

1H

6H

1D

1W

1M

ALL

I'm intentionally being somewhat vague. Certainly if someone released an option-based algorithm that achieved SOTA on Atari that would count. On the flip side an algorithm that achieved SOTA on a benchmark specifically designed to test hierarchical learning wouldn't count.[object Object]

Technical AI Timelines

Ancient Markets

Get

1,000

to start trading!

🏅 Top traders

#	Name	Total profit
1		Ṁ23
2		Ṁ14
3		Ṁ9
4		Ṁ2
5		Ṁ1

Sort by:

AFAICT this is not the case for Atari, StarCraft, Minecraft, Nethack, Procgen, any boardgames, or RLbench. Anything I missed?

People are also trading

By what factor will the cost for SotA SWE-agents drop from 2024 to 2025?

Benchmark Gap #2: Once we have an algorithm with human level sample efficiency for major RL benchmarks, how many years will it be before there is an algorithm with human level sample efficiency on essentially all AAA video game tasks?

Will AiresAI achieve the SoTA model on benchmarks by the end of the year?

By 2026 will any RL agent with learned causal models of its environment achieve superhuman performance on >=10 Atari environments?

Will Anthropic be the best on AI safety among major AI labs at the end of 2025?

Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?

Will an AI system beat humans in the GAIA benchmark before the end of 2025?

Will we have an AI generated research paper accepted to > 1 top ML conference by 2026?

At the end of 2025 will a DINO-based algorithm still be SOTA for self-supervised learning in vision?

Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?

Related questions

By what factor will the cost for SotA SWE-agents drop from 2024 to 2025?

Benchmark Gap #2: Once we have an algorithm with human level sample efficiency for major RL benchmarks, how many years will it be before there is an algorithm with human level sample efficiency on essentially all AAA video game tasks?

Will AiresAI achieve the SoTA model on benchmarks by the end of the year?

By 2026 will any RL agent with learned causal models of its environment achieve superhuman performance on >=10 Atari environments?

Will Anthropic be the best on AI safety among major AI labs at the end of 2025?

Will an autonomous agent resolve 90% of tasks on SWE-bench by 2026?

Will an AI system beat humans in the GAIA benchmark before the end of 2025?

Will we have an AI generated research paper accepted to > 1 top ML conference by 2026?

At the end of 2025 will a DINO-based algorithm still be SOTA for self-supervised learning in vision?

Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules