Will Manifold's developers agree with me that the dynamic parimutuel cost function should be changed?

292

Ṁ24K

resolved Mar 13

Resolved

YES

ALL

I believe that the dynamic parimutuel betting system as formulated by Manifold (described in the site's technical guide) significantly disincentivizes accurate price setting and should be changed. I have written a blog post arguing this point, which I intend to publish shortly. This market will resolve to Yes if Manifold's developers publicly state an intent to change their pricing implementation, and this market contributed in some way to their decision to do so. This market will resolve to No if this does not happen within a month (either because I become convinced that my argument is wrong, or if I still believe in it but the developers do not agree with me that it is an issue). Fine print: This does not require a specific change to actually be implemented within the next month, as long as the developers publicly state an intention to implement a change. If a change is made to pricing that is unrelated to this market that does not count. In the unlikely event that a change is made but it is unclear whether it is or is not related to this market I will resolve to N/A. I have no inside information about Manifold nor any pre-existing relationship with its developers or with any other prediction markets. Feb 17, 6:50pm: Here's the argument https://kevin.zielnicki.com/2022/02/17/manifold/ Feb 19, 9:40pm: Here's a TLDR summary of the issue, which I still believe is significant enough to justify a change to Manifold's betting system: If market odds change substantially over time due to arrival of new information, earlier traders will not get the payouts they were expecting from the odds at the time of their bet. This is a common occurrence in interesting prediction markets, many of one can even expect will go to nearly 1 or 0 by the time they close (which is the worst case for this issue). This significantly distorts incentives for accurate pricing.

Get Ṁ500 play money

🏅 Top traders

#	Name	Total profit
1	John Beshir	Ṁ324
2	S G	Ṁ156
3	jw	Ṁ151
4	Pepe	Ṁ72
5	Austin	Ṁ47

25 Comments

169 Trades

Sort by:

Kevin Zielnickibought Ṁ500 of YES

Thank you @SG, excited for the change!

S Gbought Ṁ500 of YES

I think you can probably resolve this as YES. I intend to switch over the betting system for new binary markets to a CFMM (constant function market maker) sometime next week, and this market did play a role in leading us to switch.

Kevin Zielnickibought Ṁ1 of YES

And re "I think -probably- if they say they currently expect to change it that should work too?" -- yes, I would consider this sufficient

Kevin Zielnickibought Ṁ1 of YES

Or to put it another way, I want to separate "intent to change" from "intent to evaluate"

Kevin Zielnickibought Ṁ1 of YES

@jbeshir I would also accept "intent to change" from the devs, I don't mean to introduce a higher level of commitment than originally set out in the market description. I just want to make sure I'm not overreading into a discussion of possible alternatives, if for example unmodified DPM is still considered a contender for market making in the long-term.

John Beshirbought Ṁ1 of YES

Just updating on that the wording in the above comment suggests it doesn't just need to be an intent to change, which could be e.g. conditional on testing working as expected with the existing algorithm a fallback position, but a "commitment", which is a higher bar than intent to change that I'm not at 97% about. I still think we're probably going to get something satisfying the market (I think -probably- if they say they currently expect to change it that should work too?), esp given that in the same channel we have a competing proposal to move to DPMM-with-sidepools which also is attempting to address this issue and I think should also qualify as a pricing implementation change, so DPMM as-is doesnt' seem to be the first fallback option here. But I'm less sure about how this is going to decide now.

Patrick Delaneybought Ṁ10 of NO

I believe we can tell who just sold $3003 worth of YES based upon some simple forensic analysis. Based upon that person's record, I'm going further in on NO.

Kevin Zielnickibought Ṁ1 of YES

From comments here & on discord, I'm inclined to think dev statements amount to an intent to change pricing in some way that would address the DPM issues discussed here, and thus the market should resolve yes (even if the exact form of the change may not yet be fully decided). @Austin or @SG could you confirm if this is a reasonable interpretation? The line I want to draw is between "we're evaluating different market makers, but may end up sticking with the current DPM implementation" which I would resolve to No (if still true at market close), while "we're evaluating different market makers, but are committed to choosing something other than the current DPM implementation" which I would resolve to Yes.

Matt Psold Ṁ6 of YES

Case in point why OP's argument was a good one - I put $10 down on this market when the implied probability was only 16%. My current expected payout for that? $24, for a profit of $14. ;P

Matt Pbought Ṁ6 of YES

For those of us not in the know, what's the general info on CPMM?

John Beshirbought Ṁ3,000 of YES

https://discord.com/channels/915138780216823849/927671564177133618/951713160660930600 - CPMM implemented (on the dev site) with a statement of intent to bring it to the main site.

jwsold Ṁ1,153 of YES

Case in point. I bought at 42%...

Bolton Baileybought Ṁ1 of YES

Buying YES as a protest, I'm very disappointed to realize that the "Payout if YES" isn't actually a guarantee. This makes manifold no better than metaculus in my opinion, but hopefully it will change.

Austinbought Ṁ1 of YES

Quick update for y'all: we are still actively evaluating different market makers; currently excited about the Polymarket-style CPMM, though it doesn't scale well to multi-category or free response questions. Thanks for your patience on this front!

Patrick Delaneybought Ṁ1 of NO

I still do not think that developers at Manifold are going to be able to respond to this request in the timeframe set up. However, I think it would be cool to allow the market maker to select which algorithm governs the bet (fixed for the duration of the market). Maybe there could be 2 or 3 different options so it's not too complex, feature different emoji/symbols for the type of market algorithm, this would be a cool way to introduce people intuitively to different styles of market algorithms.

Account deletion requestedbought Ṁ1 of YES

One more question where participating with current payout is pointless: https://manifold.markets/ValentinManes/will-george-rr-martin-publish-an-as

Patrick Delaneybought Ṁ5 of NO

Set up this market referencing this DPCF market even though my bet here on the DPCF market was no. https://manifold.markets/PatrickDelaney/will-russia-invade-ukraine-in-march

Pepebought Ṁ10 of YES

Another way of stating this is that the *best* ratio of YES odds and NO odds in this kind of market is 5.8. You can calculate this odds ratio gap as a function of the probabilities that YES and NO will reach 1 early, or some more complicated model. I recall someone at the forecasting meetup saying a typical e.g. sports betting market has a bid-ask spread of 2%. I'm guessing DPM has a larger gap than CLOB down to about a 5% chance of the market learning the outcome early.

Pepebought Ṁ10 of YES

@SG and some others have stated this as a problem with the interaction between how the math works and how information is displayed to the user. I disagree. DPM generates an enormous bid-ask spread which makes markets "will x happen by y date" markets very distorted. Consider the most popular market https://manifold.markets/Duncan/will-russia-invade-ukraine-before-t Assuming shares go to 0 or 1 before resolution, the current implied probability of buying YES is 62.5%, while NO is 21.8%. If this market resolves NO it's guaranteed to go to 0. If it resolves YES it's also quite likely to go to 1, unless the creator somehow sees the event happen before anyone else. This is not a volume issue. A market at 50% will give payoffs of 70.7% and 29.2% - a gap of 40% - no matter the volume. So how does the probability move at all? Only very confident bettors who think there's an extreme probability will participate, and we see the ratio between the extreme YES and extreme NO groups. That's some info about the distribution of beliefs and hence "true" probability, but it sure ain't the mean or median.

orrukjebought Ṁ1 of YES

Thanks for all of the helpful comments on this question. @SG could you say a little more about what you see as the disadvantages of other options, especially Hanson-style AMMs? I find DPM hard to reason about / anticipate and would feel better knowing it was the last bad option for what Manifold is trying to do :)

Patrick Delaneybought Ṁ10 of NO

I don't think there will be significant movement on the part of Manifold per your bet for three reasons: 1) On their about page I recall Manifold stating that their working hypothesis is that over time more skilled market makers will implicitly learn the flaws of this algorithm and will take on practices such as, ending the bet prior to the game beginning. I believe this is the stated working hypothesis right now, and 2) it takes a lot of resources to change code and align a team away from that. Incentivizing market makers to improve their market making capabilities with prompts and checkboxes is much simpler than changing the entire betting algorithm. 3) Dynamic models, flawed and unfair as they may be, will incentivize a lot of, "edge density," at the point of the end of the bets, and as a startup, or new platform rather, their main objective right now is increasing traffic and engagement. They don't have a, "fairness betting" dashboard, they are looking at firebase usage and trying to get users going. Basically what you are asking for is a feature request and in the reality of software development that is extremely likely to be tossed into the ice box, which means a non-commitment toward fixing, not a positive commitment.

S Gbought Ṁ1 of YES

Bet on which system we'll be using (and feel free to suggest alternatives): https://manifold.markets/ManifoldMarkets/which-betting-system-will-manifold

S Gsold Ṁ256 of NO

I'll continue to think about this. It's not that I don't see the problem here; it's just that all of the alternative mechanisms (order book, uniswap-style AMM, Hanson-style AMM) have problems of their own too. DPM works very nicely with our user-created market model but does have some very serious downsides.

Vivek Hebbarbought Ṁ1 of YES

@SG I don't think it is a rare issue; lots of bets go near 0% or 100% before trading closes.

Vivek Hebbarbought Ṁ9 of YES

Agree that the cost function should be looked at -- there are many markets where correcting a low probability by buying and holding yes is punished, causing 1) Naive traders to lose money in expectation even when they were correct about the probability being too low and 2) Knowledgable traders to refrain from correcting probabilities in these cases. For instance, if I thought this market should be at 40%, it would probably still be unprofitable to buy a large amount of yes. I think the current system also punishes putting ante even if the probability is guessed correctly.

Related questions

🏅 Top traders

Related questions