Will Manifold keep the "resolution reliability" ranking system in place for at least three months?
12
250αΉ€4266
resolved Oct 24
Resolved
NO

This market resolves as YES if, between market creation and November 10, 2023, the "resolution reliability" ranking continues to be visible on user profiles and is not removed. Otherwise, this market resolves as NO upon the feature being removed. See below for a screenshot of what I'm talking about:


Fine print

If the "resolution reliability" ranking is tweaked or edited, this market still resolves as YES as long as the basic idea behind it remains the same - i.e. presenting a text rating like "Exceptional" or "Great" rather than "4.9" or "4.6."

If the "resolution reliability" ranking is rendered invisible because of a bug, or temporarily taken down for 48 hours or fewer for some sort of maintenance or reworking, that does not cause this market to resolve as NO.

Get
αΉ€1,000
to start trading!

πŸ… Top traders

#NameTotal profit
1αΉ€480
Sort by:

I liked being referred to as exceptional 😒😒😒

It's (lamentably) gone! Only star ratings now.

Resolves NO @evergreenemily

predictedYES

Ooh, I hope they do! They've been iterating on this a lot, though.

@Conflux Right? I like it a lot too. I think it's a good idea to present something like this instead of just a number like 4.5 - it conveys the same information and it means no one has to worry about having a 4.8 instead of a 4.9 or whatever.

@evergreenemily Yeah! It’s less gameable and more interpretable. Downside is it’s less transparent and granular, but that might go along with being less gameable.

predictedYES

@Conflux I don't mind the lack of granularity, and if anything I kinda prefer it - if I'm checking someone's reviews, all I really wanna know is how likely they are to resolve their markets correctly. Something like "great" is all I need - knowing they resolve correctly 93% of the time or whatever isn't especially useful information to me.

predictedNO

@evergreenemily if it was up to you, would markets just say "Very Likely", "Unlikely", "Coinflip", etc?

mostly joking but it does feel in the spirit of Manifold to be precise

predictedYES

@Conflux Oh god, no. I've always liked the 538 model of election forecasting more than the less granular ones (even if I use the less granular ones for my own forecast because election forecasting takes an obscene amount of data.)

Maybe something like the current system with a way to click through and view more granular data? Something like:

  • Questions with a rating of 4.0 or higher: 99%

  • Questions with a rating of 4.5 or higher: 95%

  • Average rating: 4.8/5

  • Average reviews per market: 3.1

  • etc.

predictedNO

@evergreenemily That's a good idea!

Β© Manifold Markets, Inc.β€’Terms + Mana-only Termsβ€’Privacyβ€’Rules