I will score several prediction platforms on a set of 10 questions on the outcome of the 2022 US midterm elections. For each prediction platform, I will take the predicted probabilities on Monday evening, and compute the average log score (a measure of the prediction's accuracy) on these questions.
This question will resolve as per the title question. "Beat" will be defined as having a better (higher) log score. The question will resolve after all the relevant races are called.
The questions and scoring methodology are described here:
https://manifold.markets/post/comparing-election-forecast-accurac
See related questions here: https://manifold.markets/group/election-forecast-comparison
Note that the election results are highly correlated, so the platform that turns out to be most accurate may not have actually been the best set of predictions. The forecast that scores best is probably going to be the forecast that happened to best predict the broader question of how left or right skewed the entire election was, but some of that might be "luck" which it might not be able to repeat across many different election years. To truly measure accuracy well, we'd need to run this experiment several times over different election cycles.
I've selected this set of 10 questions:
Senate control
House control
Senate races
Pennsylvania - Mehmet Oz R vs John Fetterman D
Nevada - Catherine Cortez Masto R vs Adam Laxalt D
Georgia - Herschel Walker R vs Raphael Warnock D
Wisconsin - Ron Johnson R vs Mandela Barnes D
Ohio - J. D. Vance R vs Tim Ryan D
Arizona - Blake Masters R vs Mark Kelly D
Governor races
Texas - Greg Abbott R vs Beto O'Rourke D
Pennsylvania - Doug Mastriano R vs Josh Shapiro D
Close date updated to 2022-12-15 11:59 am
Results posted here: https://firstsigma.substack.com/p/midterm-elections-forecast-comparison-analysis