This market resolves to "YES" if and when Bryan Caplan publicly concedes his AI bet with Matthew Barnett.
The central case would be Caplan declaring that the central bet criterion has been met, and that an AI has gotten an A on five out of six of his most recent midterm exams, as specified in Caplan's post and this related market.
But it will also resolves "Yes" if Caplan 'concedes' early and pays Barnett or promises to.
This market resolves to "NO" if they have not publicly resolved the bet by EOD June 1 2023.
If Matthew Barnett thinks the bet should have already resolved but Caplan has not conceded, it will still resolve NO.
Background:
https://betonit.substack.com/p/gpt-retakes-my-midterm-and-gets-an
In the above post of March 21, Caplan admits that GPT-4 getting an A on one of his exams is a big update and bodes ill for his bet. But he writes "I’m not conceding the bet, because I still think there’s a 10-15% chance I win via luck." This market is about whether Caplan's luck will hold out for ~two more months.
Related questions
🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ334 | |
| 2 | Ṁ214 | |
| 3 | Ṁ176 | |
| 4 | Ṁ163 | |
| 5 | Ṁ62 |
It’s obvious that his tests do not measure critical thinking (at all) but simply having memorized what “Krugman” and “Landsberg” (?) have said, plus some overly simplistic black and white thinking.
https://betonit.substack.com/p/gpt-retakes-my-midterm-and-gets-an
—-
Making it slightly more likely:
https://betonit.substack.com/p/gpt-4-takes-a-new-midterm-and-gets/comment/14199010
I think if a YES bettor (or anyone else) wants this to resolve soon, something you could do is:
-request the midterm exams from Caplan (or, alternatively, find exams of comparable format and difficulty)
-go ahead and get all of the exams 'taken' by an AI system
-see if an econ grad student would grade them for you
If 5/6 of the exams are plausibly As, this might cause an earlier resolution. Of course, if they're not, then it shouldn't resolve this year.
@MatthewBarnett seems like AI progress could halt and he still has a good chance of losing. Are you or someone else (e.g. the Collin Gray mentioned in the post) already in the process of administering the other 5 tests to GPT-4?
@Rodeo AI could hallucinate on an exam or two and underperform. That's my guess on what he means by luck.
@Rodeo The problem is that Bryan Caplan needs to grade the exams himself in order for the bet to resolve, and he's allowed to take until 2029 under the terms. Initially I expected him to grade the exams upon request either later this year or next year, but he told me over email that he intends to wait until the deadline to resolve the bet. So, yeah.
@MatthewBarnett ah, gotcha. I guess his most recent post is some evidence that he would resolve if GPT-4 is just obviously consistently doing well on several of his exams. We’ll see!