The most common data source used on Manifold for new markets changes from Wikipedia to an LLM
Basic
7
Ṁ171
2026
14%
chance

i.e. rather than most claims referring to wikipedia as the expected future source of truth, it becomes more common to say an LLM or AI system will be used. The prompt to be used in the future can be pre-defined, like by definining resolution critieria directly by the answer to a specified question, or just referenced in general, that an LLM will be used as the data source.

Deadline: end of 2025

Get
Ṁ1,000
and
S1.00
Sort by:

How will you measure the result?

@Ansel possibly something like taking the top 100 markets by volume or trader count created in the month before due and summing up what the point to as sources of truth?

I don't expect the LLM hallucination problem to be solved that quickly.