Will Metaculus beat 538 on midterms predictions?
24
6
470
resolved Jan 1
Resolved
YES

I will score several prediction platforms on a set of 10 questions on the outcome of the 2022 US midterm elections. For each prediction platform, I will take the predicted probabilities on Monday evening, and compute the average log score (a measure of the prediction's accuracy) on these questions.

This question will resolve as per the title question. "Beat" will be defined as having a better (higher) log score. The question will resolve after all the relevant races are called.

The questions and scoring methodology are described here:

https://manifold.markets/post/comparing-election-forecast-accurac

See related questions here: https://manifold.markets/group/election-forecast-comparison

Note that the election results are highly correlated, so the platform that turns out to be most accurate may not have actually been the best set of predictions. The forecast that scores best is probably going to be the forecast that happened to best predict the broader question of how left or right skewed the entire election was, but some of that might be "luck" which it might not be able to repeat across many different election years. To truly measure accuracy well, we'd need to run this experiment several times over different election cycles.

I've selected this set of 10 questions:

  • Senate control

  • House control

  • Senate races

    • Pennsylvania - Mehmet Oz R vs John Fetterman D

    • Nevada - Catherine Cortez Masto R vs Adam Laxalt D

    • Georgia - Herschel Walker R vs Raphael Warnock D

    • Wisconsin - Ron Johnson R vs Mandela Barnes D

    • Ohio - J. D. Vance R vs Tim Ryan D

    • Arizona - Blake Masters R vs Mark Kelly D

  • Governor races

    • Texas - Greg Abbott R vs Beto O'Rourke D

    • Pennsylvania - Doug Mastriano R vs Josh Shapiro D


Close date updated to 2022-12-15 11:59 am

Get Ṁ200 play money

🏅 Top traders

#NameTotal profit
1Ṁ79
2Ṁ70
3Ṁ68
4Ṁ25
5Ṁ14
Sort by:

Which of the 538 models are we talking about here?

predicted YES

@Sjlver Deluxe, i.e. what's on this page: https://projects.fivethirtyeight.com/2022-election-forecast/

Good question!

predicted YES

Where do I find the Classic model forecasts? I'd be interested to compare that as well.

Will Metaculus beat 538 on midterms predictions?, 8k, beautiful, illustration, trending on art station, picture of the day, epic composition