Presidential debate AI factcheck. Does GTP-4o think these statements from the debate are true?
💎
Premium
54
Ṁ100k
resolved Sep 20
Resolved
YES
Harris: "Even his national security advisor said it was a terrible deal"
Resolved
YES
Trump "I got more votes than any sitting president by far"
Resolved
YES
Harris: "He admires dictators, wants to be a dictator himself"
Resolved
YES
Harris: "It’s well-known that these dictators are rooting for you to be President again."
Resolved
YES
Trump: "NATO paid hundreds of billions when I said either you pay up or we’re not going to protect you any more."
Resolved
NO
Trump: "I have nothing to do with project 2025."
Resolved
NO
Trump: "We handed them over a country with an economy and a stock market that was higher than [when the pandemic started]"
Resolved
NO
Trump: "They didn’t fire anyone having to do with the Taliban."
Resolved
NO
Harris: "If donald trump were president putin would be sitting in Kiev right now."
Resolved
NO
Harris: “Donald Trump has said that there will be a bloodbath if this election is not to his liking”
Resolved
NO
Trump: "They are taking over towns, they are taking over buildings"
Resolved
NO
Trump: "They didn't include the worst cities"
Resolved
NO
Trump: "We have the biggest rallies, the most incredible rallies in the history of politics"
Resolved
NO
Trump: "They weaponised the justice system"
Resolved
NO
Trump: "I had virtually no inflation"
Resolved
NO
Trump: "They allowed many many millions of criminals, terrorists, common street criminals to come into our country"
Resolved
NO
Trump: "Crime here is up and through the roof"
Resolved
NO
Harris: "Donald Trump left us the worst unemployment since the great depression."
Resolved
NO
Trump: "She goes down as the worst [VP] in the history of our country."
Resolved
NO
Trump: "I was given a fraction of [400 million]"

Add specific sentences from the debate here. In a week, I will put them into GPT-4o with internet access, perhaps the surrounding context and a prompt saying something like "if you had to say this statement was true or false which would you go for"

Will each statement resolve true or false?

Get
Ṁ1,000
and
S3.00
Sort by:

@mods I misresolved the market about the taliban. Could that be resolved false?

@Bayesian How come i wasn't able to do this myself

@NathanpmYoung Only mods can unresolve options now I think

@Bayesian I am a mod.

@NathanpmYoung oh lol mb. you should be able to then. however:
idrk whether this button works:

and instead you gotta go on a specific option, press the ..., edit, and type unresolve to unresolve a specific option.

@NathanpmYoung Wow GPT is bad at this

@Yiddishe_Kupp1980 I mean yeah a bit. But doing it myself would have been stressful. What would have been better.

@NathanpmYoung You clearly stated that you were using GPT (and which model) so no complaints here about the resolution, but just surprised by this one. I think it shows the limits of these models.

Honestly ChatGPT seems more pro harris than I am.

Yes resolution counter to the market.

Surprising yes resolution. Pretty surreal to read

@NathanpmYoung so close and yet so far

It did not want to both google factchecks and end in the word true or false

Economic health resolves slightly counter to market.

Project 2025 resolves counter to the market

@NathanpmYoung I was confused by this statement- on the graph it looks like it ended a bit below 50% - until I checked the trade logs: someone bid it up to 75% from 45% around three minutes before closing. Almost literally a last-minute trade.

I think it's pretty likely the market would have corrected if there had been time. I'd probably have bid it back down, for one, I bought NO at a way worse price than that.

I wanted to do no interpretation at all, so this one didn't have a definitive true or false so I changed the prompt afterwards. Surprisingly this changed the valance of the answer. Perhaps if I did it again, I would use several models.

Before:

Afterwards:

I will post the surprising ones then.

Do you lot want me to post every single factcheck as a separate comment? That feels obnoxious, but will probably get more discussion. Currently there are going to a document here: https://docs.google.com/document/d/1yPrfRUqeHHUySYw59H0AzvGLmcZJFNJxAs98Gcp06ps/edit?usp=sharing

I prefer separate comments, since any of them might end up as discussions.

@ijk1 I think if people want to talk about one (or several of them together), they could just repost it here, right? We don't need to do that for every single one just in case.

@NathanpmYoung Friendly ping. ☺️ I know this is a bit of work to resolve -- just hoping to free up some liquidity.

@yetforever Yup it’s a high priority for me.

bought Ṁ350 NO

Two things I found useful for prompting ChatGPT:

  • To stop it from just hedging and saying "it's complicated", it helps to ask "if you had to say this statement was true or false, which would you go for? Be clear about the rating you give."

  • Explicitly asking "Use your web search feature if needed" helps ensure it always pulls context and sources from the web.

© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules