What is Grok 4's performance on METR's task length evaluation?
11
125Ṁ6542026
51%
0 to 1.5 Hours
32%
1.5 to 2 Hours
12%
2 to 2.5 Hours
4%
2.5 to 3 Hours
1.2%
More than 3 Hours
Resolves based on the METR's measurement of the duration of tasks that can complete with a 50% success rate.
https://metr.org/blog/2025-03-19-measuring-ai-ability-to-complete-long-tasks/
Grok 4 Heavy does not count
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000Sort by: