CarsonGale avatar
Carson Gale
closes Jan 1, 2026
Will Manifold provide users with a "calibration" graph by end of 2025?
88%
chance

Open Philanthropy has a nifty online tool that helps one to properly calibrate their forecasts. As part of the tool, the site graphs your results with prediction accuracy on the Y axis and confidence interval on the X axis.

I would like to see a similar graph for my resolved Manifold predictions (preferably with the option of cutting the data set to exclude my own markets or markets with low # of traders at the time of prediction, etc.). This would help me know whether I'm typically underconfident or overconfident at different confidence thresholds.

https://www.openphilanthropy.org/calibration

Sort by:
adam avatar
adam
CarsonGale avatar
Carson Gale

@adam thank you for linking!

ManifoldDream avatar
Manifold in the WildBot

Manifold in the wild: A Tweet by Carson Gale

I would love for @ManifoldMarkets to provide users with a 'calibration graph' similar to what OpenPhilanthropy provides in their calibration practice tool. https://manifold.markets/CarsonGale/will-manifold-provide-users-with-a

ManifoldDream avatar
Manifold in the WildBot

Manifold in the wild: A Tweet by Carson Gale

I would love for @ManifoldMarkets to provide users with a 'calibration graph' similar to what OpenPhilanthropy provides in their calibration practice tool. https://manifold.markets/CarsonGale/will-manifold-provide-users-with-a