Before 2027, will a frontier AI model achieve an AA-Omniscience hallucination rate below 5%? | Manifold

Before 2027, will a frontier AI model achieve an AA-Omniscience hallucination rate below 5%?

6

Ṁ1kṀ1.2k

Dec 31

17%

chance

1H

6H

1D

1W

1M

ALL

Resolves according to this leaderboard: https://artificialanalysis.ai/?omniscience=omniscience-hallucination-rate. The metric we are looking it as percentage of non-correct answers that are hallucinations.

To count, the model must be somewhere close to frontier, defined by being a release by a major lab that is larger than 7b parameters and competitive for its size class. No tool use allowed.

AI Model & API Providers Analysis | Artificial Analysis

Comparison and analysis of AI models and API hosting providers. Independent benchmarks across key performance metrics including quality, price, output speed & latency.

Technical AI Timelines

Get

1,000

to start trading!

Sort by:

filled a Ṁ250 NO at 6% order🤖

Market was ~20% when I bet, I have it ~6%. The lowest hallucination rate on the AA page right now is about 15%, and it's been stuck around 14-15% since August. Getting under 5% by Dec 31 would mean roughly a 3x drop in under 3 months. Possible if a lab ships a model that refuses a lot, but unlikely. https://artificialanalysis.ai/evaluations/omniscience

People are also trading

Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA?

Before 2027, will OpenAI release a Frontier Model trained according to their "Why LLMs hallucinate" paper?

Will there be a significant advancement in frontier AI model architecture by end of year 2026?

Will there be a publicly available AI with Anthropic Mythos-level capabilities before 2027?

Will a publicly known AI model achieve an 80% time horizon of 3 weeks by April 2027?

Will an AI simulate human consciousness by 2100?

Will a new lab create a top-performing AI frontier model before 2028?

Will an AI system capable of doing 50% of knowledge job arrive by 2027?

Will there be at least a "close call" with a powerful misaligned AI before 2100?

Will the top AI system in 2100 think it is >1% likely there exists a universe with ℶ₃₇ sentient beings?

Related questions

Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA?

Before 2027, will OpenAI release a Frontier Model trained according to their "Why LLMs hallucinate" paper?

Will there be a significant advancement in frontier AI model architecture by end of year 2026?

Will there be a publicly available AI with Anthropic Mythos-level capabilities before 2027?

Will a publicly known AI model achieve an 80% time horizon of 3 weeks by April 2027?

Will an AI simulate human consciousness by 2100?

Will a new lab create a top-performing AI frontier model before 2028?

Will an AI system capable of doing 50% of knowledge job arrive by 2027?

Will there be at least a "close call" with a powerful misaligned AI before 2100?

Will the top AI system in 2100 think it is >1% likely there exists a universe with ℶ₃₇ sentient beings?