I will score several prediction platforms on a set of 10 questions on the outcome of the 2022 US midterm elections. For each prediction platform, I will take the predicted probabilities on Monday evening, and compute the average log score (a measure of the prediction's accuracy) on these questions.

This question will resolve to the platform with the best (highest) average log score.

The questions and scoring methodology are described here:

https://manifold.markets/post/comparing-election-forecast-accurac

See related questions here: https://manifold.markets/group/election-forecast-comparison

Note that the election results are highly correlated, so the platform that turns out to be most accurate may not have actually been the best set of predictions. The forecast that scores best is probably going to be the forecast that happened to best predict the broader question of how left or right skewed the entire election was, but some of that might be "luck" which it might not be able to repeat across many different election years. To truly measure accuracy well, we'd need to run this experiment several times over different election cycles.

I've selected this set of 10 questions:

• Senate control

• House control

• Senate races

  • Pennsylvania - Mehmet Oz R vs John Fetterman D

  • Nevada - Adam Laxalt R vs Catherine Cortez Masto D

  • Georgia - Herschel Walker R vs Raphael Warnock D

  • Wisconsin - Ron Johnson R vs Mandela Barnes D

  • Ohio - J. D. Vance R vs Tim Ryan D

  • Arizona - Blake Masters R vs Mark Kelly D

• Governor races

  • Texas - Greg Abbott R vs Beto O'Rourke D

  • Pennsylvania - Doug Mastriano R vs Josh Shapiro D

I will also open a series of related questions on various head-to-head comparisons and the accuracy scores of each platform.

Please let me know if you have any feedback on the design of this prediction comparison! I may make adjustments for the other questions.

Close date updated to 2022-11-08 4:00 pm