What are the best ways to operate a self-resolving (resolve-to-MKT) question?
11
181
resolved Oct 1
19%13%
Simple resolve to MKT at close, with subjective author override if the market isn't working as intended
19%4%
Close at a random/arbitrary time within a window
19%4%
Poisson process - close with probability p in every day or hour or minute
19%3%
(Quiescence) Close if market probability hasn't changed >x% in the last y hours
10%0.4%
Quadratic vote
5%8%
Close to average market prob over last 24 hours
5%12%
Random sample average from time before close
5%7%
Some kind of Poisson or average process, but hire an expert if the total number of shares exceeds some threshold.
35%
don't
0.0%
Close at fixed time, resolve to the probability it had at a random time in a window.
0.7%
Close at a random time within a window, but only if the current price is above or below some threshold values.

This is intended more as a place for discussion than a market. I'm tentatively planning to resolve equally to the mechanism I end up using for https://manifold.markets/jack/will-biden-be-president-on-915-reso, and the mechanism(s) that I would ideally use for other new self-resolving markets (which may be the same or different answers). I'll look at answers as broad ideas, I'm not expecting them to spell out all the details exactly.

In the answers I'll be adding the main ideas I've been considering so far.

Motivation: First, why even bother with self-resolving markets? Because there are many ambiguous, hard-to-resolve questions that can't easily be answered by objective criteria. One solution is for the author to subjectively resolve, but this can lead to disagreement and potential bias. Another is to take a poll. Or, you can have the market collectively decide - a "self-resolving" mechanism which usually means resolving to the market probability. However, there are many concerns about how well such mechanisms work and how reliable they are especially against price manipulation.

Issues and goals

One of the most obvious issues with the simplest form of resolve-to-market-probablity is that the market can become completely disconnected from the question it is trying to answer (Keynesian beauty contest), because unlike a normal prediction market the payouts aren't actually based directly on the question. This can sometimes be addressed by adding rules like "if it looks like the market isn't answering the intended question then the author will override it" or by sometimes resolving the market based on external data, possibly probabilistically (like in https://manifold.markets/jack/did-hans-niemann-cheat-against-magn or https://www.metaculus.com/questions/3681/will-it-turn-out-that-covid-19-originated-inside-a-research-lab-in-hubei/).

Another major issue with this simple rule is it can encourage last-minute trading to push the price up or down, making the resolution unreliable due to high potential for manipulation and/or volatility. So people have explored many different mechanisms to avoid that, and that will be my main focus here.

Some of the goals I have in mind (which cannot necessarily all be satisfied together):

  • Use objective rules. For many questions, subjective criteria like "the market doesn't look like the price has suddenly changed too much" are fine, but it's better if it can be operationalized into an objective criteria to prevent any potential ambiguity or bias, without making that gameable. And in particular for high-stakes markets like the current Biden market I want it to be 100% objective.

  • Be as robust as possible against gaming and manipulation. For many questions, that's not a big issue, but for some questions like https://manifold.markets/jack/will-biden-be-president-on-915-reso it becomes much more important.

  • Be easy for the author to run the operations, and easy for traders to understand how it's working.

  • Be fair. And moreover, it's also highly desirable for the fairness to be publicly verifiably. E.g. a mechanism based on generating a random number may be fair if run honestly, but a dishonest operator could cheat without detection; whereas using a public randomness beacon ensures it is both fair and verifiably fair.

  • Resolve in a timely fashion, and ideally with a predictable duration.

Get Ṁ200 play money

🏅 Top traders

#NameTotal profit
1Ṁ28
2Ṁ25
3Ṁ9
4Ṁ4
Sort by:
answered
Random sample average from time before close

Basically the same as the average market probability over the time over close, and has the same downsides.

answered
Close to average market prob over last 24 hours

After using this in the Biden market, I encountered two main problems:

  • The market prob earlier in the day restricts the possible range of resolution outcomes and hence affects betting strategy later in the day.

  • Getting the script to compute it working right was nontrivial, there are still some mysterious bugs in my script that I didn't have time to debug.

answered
Some kind of Poisson or average process, but hire an expert if the total number of shares exceeds some threshold.

@Yev Works well for questions that are objective and answerable but costly (e.g. hiring an accountant to answer is M$ taxable, or perhaps a mathematician to answer what's the biggest number). Still doesn't really work for most questions that you'd want to resolve-to-mkt, I think. Also there's the question of who pays for it. Still, I think it's an interesting idea that has some promise.

answered
don't

I think it's worth exploring.
It's worse than beauty contest in that you have to tack on hacks to prevent last-minute market manipulation.

I think any market that's meta gets high engagement. Ponzi is fun, and it directly incents participation. The most popular market ever is maybe Predictor's uptip / downtip market. However, I think most people don't trust resolve-to-mkt to give them accurate knowledge

answered
Some kind of Poisson or average process, but hire an expert if the total number of shares exceeds some threshold.
bought Ṁ10

The Biden market had over 2 million shares (for each outcome). That's over US$20000. That should hopefully be enough to hire a political scientist who can tell us once and for all who the president is.

answered
Close at a random time within a window, but only if the current price is above or below some threshold values.
answered
Close at fixed time, resolve to the probability it had at a random time in a window.

@Yev I'm going to treat this as basically the same as my answer "Close to average market prob over last 24 hours" (the 24 hours part can of course be changed as desired). Unless you had some other difference in mind?

answered
don't

Also, empirically this is a popular form of market - see this group https://manifold.markets/group/selfresolving. Polls are also popular but currently they have to be implemented by hand-counting votes in the comments which is a lot of work for the author and very error-prone.

answered
don't

I'm not sure what you mean by worse than beauty contest. Isn't it basically the same idea? The original Keynesian beauty contest was a poll where you predicted others' answers on the same poll; this is a market where you predict others' trades on the same market - same basic idea.

answered
don't

@Sinclair I agree that there are some major downsides compared to polling, but there are also upsides (the same upsides that make prediction markets generally work better than expert polls in normal questions). I think it's worth exploring the space of possibilities and seeing if the downsides can be mitigated.

answered
Close to average market prob over last 24 hours

@jack This seems like the simplest choice. It's verifiably fair and easy to run. And I don't think you can game it unless you are a megawhale (which is a problem for all resolve-to-MKT).

answered
Quadratic vote
bought Ṁ1

Calculate total mana per user, take the root. Sum across all users by YES/NO. Square the sums. Use the ratio of squared sums to calculate the resolution.

Worked example:

  • Alice bets m100 on YES (10 votes)

  • Bob bets m400 on YES (20 votes)

  • Charlie bets m100 on NO (10 votes)

Result is 30 YES to 10 NO.

Square both sides: 900 YES to 100 NO.

Resolve to 90%.

answered
don't
bought Ṁ10

Resolve to mkt is worse than polling, worse than beauty contest even

answered
(Quiescence) Close if market probability hasn't changed >x% in the last y hours
bought Ṁ5

Example: https://manifold.markets/MartinRandall/is-the-sky-blue-resolves-to-mkt

Need some way to prevent it from going on forever though, probably by combining it with one of the other ideas.

answered
Close to average market prob over last 24 hours
bought Ṁ1

This has the nice property of smoothing out volatility, and just like the randomized close approaches it also avoids too much incentive to manipulate the price at any given time by spreading that out over time. It's also relatively simple and less can go wrong compared to a randomized close procedure.

Calculating the average probably is best done by the API. Another viable approach is to randomly sample a few timestamps and average those.

You can also do an approach where at the end of every day, you use a RNG to decide whether to close with probability p, and if it does close then you resolve to the average over the last 24 hours.

answered
Close at a random/arbitrary time within a window

I looked into a couple options for public randomness sources. On the simple end of the spectrum, we have things like:

These still rely on the website not being hacked or whatever. Then there are ones with strong verifiability and security properties, known as public randomness beacons:

answered
Poisson process - close with probability p in every day or hour or minute

Also this is very similar to close at random time within a window, see my other comments there.

answered
Poisson process - close with probability p in every day or hour or minute
bought Ṁ1

To do it more continuously it needs to be automated - this can be done through the API for closing and/or resolving markets (closing was just added by ian). If it's e.g. every day then it can be done manually, but this can create incentive for people to do a bunch of last-minute trading right before each potential close event.

answered
Close at a random/arbitrary time within a window

Note that the random number generation can use a public randomness source to prevent author cheating. This is more complex however.

answered
Close at a random/arbitrary time within a window

A more complex scheme to randomize the close time: https://manifold.markets/jack/what-is-the-probability-that-a-coin.

The market close will be a date chosen uniformly at random between 9/24 and 9/26 (inclusive), to help avoid issues with last-minute trading. Here is a possible procedure I may use (subject to change): On each day, I will generate a random integer between 1 and the number of days remaining, and if the generated number is 1 then I will close the market. The time I perform this procedure on each day will be arbitrary, and I will not perform any trading immediately before or after carrying out this procedure.

answered
Close at a random/arbitrary time within a window
bought Ṁ1

Resolves to MKT at close. Close time will be a randomized or arbitrary time within a window (chosen by the author). E.g. https://manifold.markets/jack/how-clear-do-you-think-manifolds-co

answered
Simple resolve to MKT at close, with subjective author override if the market isn't working as intended

You can also have some chance of resolving based on external data, like in my Hans Niemann market (if conclusive evidence comes out), or in the Universal Basic Income market (if the comments seem to arrive at a consensus).

answered
Simple resolve to MKT at close, with subjective author override if the market isn't working as intended
bought Ṁ1

Simplest starting point is just "resolves to MKT at close" with a fixed, predefined close time, perhaps with a clause along the lines of "if it looks like the market is being manipulated or something else looks wrong then the author will manually override it"

Examples: