Will the mean answers get a better Brier score than the median answers of Blind Mode participants in the ACX 2023 prediction contest? | Manifold

Will the mean answers get a better Brier score than the median answers of Blind Mode participants in the ACX 2023 prediction contest?

Basic

11

Ṁ601

resolved Jan 4

Resolved

NO

1D

1W

1M

ALL

Manifold has a group for questions from the 2023 ACX contest. Scott has released the answers of blind mode participants in this post. Once all markets in the linked group have resolved, this market will resolve according to whether the mean answers have a lower (better) Brier score than the median answers from the data in the linked post.

This question is managed and resolved by Manifold.

#Predictions on Predictions

#New Year's Resolutions 2024

Get

1,000

and

3.00

Sort by:

predictedNO

Final Brier scores, (ignoring the N/A resolution) were:

0.172 for the blind mode mean

0.161 for the blind mode median

0.167 for Manifold

Google sheet for prediction help

I don't follow the resolution criteria here. What mean are you referring to - Manifold prediction averaged over time?

@jack Sorry, the manifold predictions don't factor into this one at all - it's the blind mode mean vs blind mode median.

Related

Related questions

What will be the best normalized score achieved on the original 7 RE-Bench tasks by December 31st 2025?

Will the aggregated blind mode predictions outperform aggregated full mode predictions in the 2023 ACX prediction contest?

In 2026, will the largest AI-based commercial forecasting system (by revenue) have a platform-wide Brier score <0.1?

Zvi Blind vs. Manifold 2024 ACX Predictions: Who Maximizes Brier Score? (% resolution)

Will I be able to predict my partner better than she can predict me? (M$50 bounty for good questions.)

Will Manifold outperform Metaculus in the 2024 ACX Contest?

Related questions

What will be the best normalized score achieved on the original 7 RE-Bench tasks by December 31st 2025?

Zvi Blind vs. Manifold 2024 ACX Predictions: Who Maximizes Brier Score? (% resolution)

Will the aggregated blind mode predictions outperform aggregated full mode predictions in the 2023 ACX prediction contest?

Will I be able to predict my partner better than she can predict me? (M$50 bounty for good questions.)

In 2026, will the largest AI-based commercial forecasting system (by revenue) have a platform-wide Brier score <0.1?

Will Manifold outperform Metaculus in the 2024 ACX Contest?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules