Before 2027, will a frontier AI model achieve an AA-Omniscience hallucination rate below 5%? | Manifold

Before 2027, will a frontier AI model achieve an AA-Omniscience hallucination rate below 5%?

1

1kṀ50

2026

48%

chance

1H

6H

1D

1W

1M

ALL

Resolves according to this leaderboard: https://artificialanalysis.ai/?omniscience=omniscience-hallucination-rate. The metric we are looking it as percentage of non-correct answers that are hallucinations.

To count, the model must be somewhere close to frontier, defined by being a release by a major lab that is larger than 7b parameters and competitive for its size class. No tool use allowed.

AI Model & API Providers Analysis | Artificial Analysis

Comparison and analysis of AI models and API hosting providers. Independent benchmarks across key performance metrics including quality, price, output speed & latency.

Technical AI Timelines

Get

1,000

to start trading!

People are also trading

Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?

Will we have better-than-human-aggregate forecasting AIs by the end of 2024?

Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA?

Will any AI model achieve > 40% on Frontier Math before 2026?

Will any AI model be capable of involuntarily hypnotizing human beings by EoY 2025?

AI honesty #1: by 2027 will we have AI that doesn't hallucinate random nonsense?

Will an AI achieve >80% performance on the FrontierMath benchmark before 2027?

Before 2027, will OpenAI release a Frontier Model trained according to their "Why LLMs hallucinate" paper?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

Related questions

Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?

Will we have better-than-human-aggregate forecasting AIs by the end of 2024?

Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA?

Will any AI model achieve > 40% on Frontier Math before 2026?

Will any AI model be capable of involuntarily hypnotizing human beings by EoY 2025?

AI honesty #1: by 2027 will we have AI that doesn't hallucinate random nonsense?

Will an AI achieve >80% performance on the FrontierMath benchmark before 2027?

Before 2027, will OpenAI release a Frontier Model trained according to their "Why LLMs hallucinate" paper?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

© Manifold Markets, Inc.•Terms•Privacy