Resolve's when the o3 model is usable in the ChatGPT app (mobile or web) for people with a Plus level subscription (which at the time of writing is $20/month).
Update 2024-22-12 (PST) (AI summary of creator comment): - Only a model named exactly "o3" will count for resolution
Exceptions are if the model is named "o3 high" or "o3 low"
Or if there is clear evidence that a model was renamed from "o3" to something else
Models named "o3-mini" or "o3-preview" will not count
1,000
3.00interesting part of this is the cost to run:
https://arcprize.org/blog/oai-o3-pub-breakthrough
$7,000 to get 83% on the eval. That's definitely not coming to a $20/month subscription unless there's a breakthrough on compute or very stringent limits on usage.
will o3-mini, o3-preview, or some other such named version count?
@LiamZ Mini: no, preview: no. The only way this (or the sister market) resolve YES without a model named precisely ”o3” being released is if the models are “o3 high” or “o3 low”, or it’s clear “the model previously known as o3 we have now rebranded to x”
@gallerdude cheers thanks. Based on reported costs I expect a 3o-mini right now within 6 months or so but that 3o itself might be held back as a major selling point for the higher subscription tiers.