Will any foundation model score 75 or higher on The Foundation Model Transparency Index by the end of 2024? (LLama2: 54)
20
1kṀ12kDec 31
96%
chance
1D
1W
1M
ALL
The top-scoring model scores only 54 out of 100. No major foundation model developer is close to providing adequate transparency, revealing a fundamental lack of transparency in the AI industry.
There are 100 indicators that determine this score:
Read more: https://crfm.stanford.edu/fmti/
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000
Related questions
Related questions
Will the mean score for The Foundation Model Transparency Index be 50% or more by the end of 2025? (current: 37%)
52% chance
Will an AI score over 80% on FrontierMath Benchmark in 2025
29% chance
Will there be a score of 80% or higher on Humanity's Last Exam before April 1, 2025?
3% chance
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
45% chance
Will AI image generating models score >= 90% on Winoground by June 1, 2025?
83% chance
Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?
23% chance
Will the market of foundation models be more fragmented than in 2024 by EOY 2026?
58% chance
Will any AI model achieve > 40% on Frontier Math before 2026?
84% chance
Will an LLM agent complete >50% of the lab tasks on the Factorio Learning Environment benchmark in 2025?
29% chance
Will Mistral's next model make it to the top 10 models in LLM Arena by the end of 2025?
45% chance