Does using Fermi Estimation for calculating probabilities outperform not using it?
Mini
3
54
Jan 1
33%
chance

This resolves YES if I find convincing evidence that forecasters have improved performance when they use Fermi Estimation for calculating their probabilities. To be clear, I'm not looking for Fermi Estimation as a means of discovering some underlying fact: "What's the chance of a second Emu War in Australia in 2025? Well first I need to estimate the number of Emus..." but rather directly modelling the final probability as a sort of Fermi estimate equation.

This evidence may already exist today. If so, all that's sufficient to resolve this market is to link that evidence here. However, if positive evidence comes in, I will wait for contradicting evidence before resolving and weigh the balance of the evidence. I'm not looking for one-off anecdotes either -- I know Nate Silver goofed on Donald Trump using something like this method, for instance. Please link actual studies or at least something with multiple repeated instances that we can scrutinize and quantify.

To be clear: the spirit of this market is to try to gather some empirical evidence for better understanding the so-called "multi-stage fallacy" which takes a dim view of using Fermi Estimation to arrive at probabilities -- the argument is that you can add in as many stages as you want to artificially lower the percentage to nothing, because any number of probabilities multiplied together shrink fast. Also concerns about correlation/dependence between probabilities.

My hunch is we should have enough evidence to arrive at a better gut understanding of this that outperforms armchair theorizing. Either it works or it doesn't, and there's already plenty of incentive for people to have tried it. And maybe there's better or worse ways to use it, which seems important.

Curious minds want to know.

Get Ṁ1,000 play money