By when will 85% be reached on the public evaluation set on ARC-AGI-Pub?
➕
Plus
21
4.0k
2030
35%
01/01/2025
58%
01/01/2026
67%
01/01/2028
75%
01/01/2030

See https://arcprize.org/arc-agi-pub.

This allows for arbitrary API usage unlike the ARC-AGI prize.

I will resolve based on when the date when the method is first reported even if it is not submitted until substantially later (due to e.g. no public API).

I will apply a restriction roughly in line with the $10,000 runtime cost contraint, though it is unclear how this should resolve with respect to private models with no known API price.

I will exclude solutions that seem heavily overfit based on the semi-private evaluation set.

(Cut off data is resolved based on midnight PT.)

Get Ṁ600 play money