What will @PeterNjeim's Resolution rating be after his "Who will be the prime minister of Canada" Question Resolves?
55
1kṀ17k
resolved May 8
100%99.4%
1-2 Stars (or below 1 star in the spirit of the market)
0.2%
2-3 Stars
0.2%
3-4 Stars
0.1%
4-5 Stars

I will wait about 3 days after the question is resolved, so there is ample chance for everyone to rate the question.

https://manifold.markets/PeterNjeim/who-will-be-the-next-prime-minister-f13eee1bee08?r=SGlsbGFyeUNsaW50b24

Snapshot before resolution:

Current Rating Page:

https://manifold.markets/PeterNjeim?tab=questions

Resolution criteria:

This market will resolve to the resolution rating assigned to @PeterNjeim after he resolves his "Canada Election Market." The resolution rating is a measure of a market creator's accuracy and reliability in resolving markets on Manifold. It is calculated based on the correctness and timeliness of their market resolutions. The rating is typically displayed on the user's profile page. If the "Canada Election Market" is not resolved by @PeterNjeim, this market will resolve as N/A.

Background:

@PeterNjeim is the creator of the "Who will be the prime minister of Canada after the next election?" market on Manifold. (manifold.markets) This market has garnered significant attention and participation from the community. The resolution rating reflects a creator's track record in accurately resolving markets, which is crucial for maintaining trust and credibility within the prediction market platform.

  • Update 2025-05-02 (PST) (AI summary of creator comment): If the Overall resolution rating displayed on the profile is exactly 4.00 Stars, the creator will use the "Unweighted Average" rating as the tiebreaker to determine the final resolution value.

  • Update 2025-05-04 (PST) (AI summary of creator comment): If the final resolution rating for @PeterNjeim is below 1 star, the creator will resolve this market to 1-2 Stars. This is based on the creator's statement that they were previously unaware a rating below 1 star was possible.

  • Update 2025-05-04 (PST) (AI summary of creator comment): If there is considerable controversy regarding the resolution, the creator may open the resolution to a vote.

The creator is currently heavily leaning towards resolving according to their prior statement (summarized in the update from 2025-05-04) as the fairest option.

Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ810
2Ṁ314
3Ṁ212
4Ṁ104
5Ṁ70
Sort by:

He has been banned so can probably be resolved now lol

@Lorelai You are still able to rate his resolution though.

Trust me, I don't like waiting, but I promised to give 3 days to rate him.

Where’s my mana 😭

turns out the answer is "user was banned for trying to screw with the market"

bought Ṁ18 NO

What if it is below 1? 😅

@4fa

Good point

I think it wouldn't be too controversial to resolve to the lowest rung. I am biased, though.

@lumi How is this possible? You can only rate 1-5 stars no? Not zero.

@Quroe I will resolve this in good faith to 1-2 Stars, but I need to wait 3 days. This is the spirit of the market.

The reason is the following: I was not aware that you could be rated below 1 star. I don't think anyone was. I would love for a @mods to explain how the star rating system works. I didn't think this was possible.

@HillaryClinton "Manifold's weighted rating" must have some wonky negative weights. 😁

@HillaryClinton Sounds good to me. Just wanted to make sure. 👍

I imagine it's mapping the user to a scale of where they sit among all users. Like, a scale of 0 to 100, where 0 on the scale is mapped to 0 stars and 100 on the scale is mapped to 5 stars.

I'm talking out of my butt and this is all conjecture.

@4fa I lost money on this market, so I don't think I'm biased. But if there is considerable controversy I will open it for a vote. That being said, I am heavily leaning towards that being the fairest option.

Yes, wonky weights.

@4fa That rating is some "lower bound of 95th percentile confidence interval" (https://github.com/manifoldmarkets/manifold/blob/0c3e2a968560a949411dd61f460f6f3d79febe62/backend/supabase/functions.sql#L349-L390).

Likely predicting "is it probable that a next market by this user will also be good, excluding outlier reviews?".

@AnT Ah, nice! I first thought they did not think of the bounds, but they thought of the bounds – just incorrectly. They "squash with sigmoid, multiply by 5", but maybe they should use the sigmoid, multiply by 4 and add 1.

@AnT I took a closer look.

It doesn’t appear to explicitly exclude outliers, but it does simplify the data by quantizing everything into two buckets ("4-5 stars" and "1-3 stars"):

```
positive_counts AS (

SELECT 5 + COUNT(*) AS count FROM avg_ratings WHERE avg_rating >= 4.0

),

negative_counts AS (

SELECT COUNT(*) AS count FROM avg_ratings WHERE avg_rating < 4.0

),
```

@Bayesian Do you have any stats on average question rating? Like if a user is 3.00 stars, what percentile does that put them in for user ratings?

@HillaryClinton No mb, but seems mostly predicted by ur number of overall reviews.c most people with that bad rating prolly have only like one bad market anf nothing else. Not sure tho

i would suspect he gets a decent rating here, since ratings get bad during contentioud resolution, wjich this isnt? Excrpt timingwise i spose

@Bayesian He only has 4 other ratings, so I assume whatever this will dominate his rating. (not sure how the weighted system works though).

My theory is a lot of people are not happy, as every news organization and website has called the winner.

That being said, even if I'm right, it could be like Uber where anything below a 4.00 is really bad. People tend to be generous with their reviews. I wish I knew the stat, but if he ends up with anything below 4.00, that's definitely bottom 20% or so.

@HillaryClinton Yeah like 90%+ of reviews are either 5 or 1.

filled a Ṁ10 YES at 26% order

if I might do some publicity for my Peter Njeim market: https://manifold.markets/nikthink/peter-njeims-canadian-election-mark

you can comment your Peter Njeim markets on my market too.

@nikthink I like it! Good market.

bought Ṁ50 YES

If his overall rating is exactly 4 stars, which option does this resolve to?

@TimothyJohnson5c16 I will use the "Unweighted Average" as the tie breaker if it is exactly 4.00 Stars. The one circled in red is the tie breaker.

© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules