Will any foundation model score 75 or higher on The Foundation Model Transparency Index by the end of 2024? (LLama2: 54)
20
1kṀ12kDec 31
96%
chance
1D
1W
1M
ALL
The top-scoring model scores only 54 out of 100. No major foundation model developer is close to providing adequate transparency, revealing a fundamental lack of transparency in the AI industry.
There are 100 indicators that determine this score:
Read more: https://crfm.stanford.edu/fmti/
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000
Related questions
Related questions
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
62% chance
Will an AI score over 80% on FrontierMath Benchmark in 2025
22% chance
Will the mean score for The Foundation Model Transparency Index be 50% or more by the end of 2025? (current: 37%)
52% chance
Will any AI model achieve > 40% on Frontier Math before 2026?
81% chance
Will AI image generating models score >= 90% on Winoground by June 1, 2025?
83% chance
Will any model score 70+% on ARC AGI 2 within 3 months of its release?
7% chance
Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?
18% chance
Will the market of foundation models be more fragmented than in 2024 by EOY 2026?
58% chance
Will an LLM agent complete >50% of the lab tasks on the Factorio Learning Environment benchmark in 2025?
29% chance
Will any AI model score above 95% on GRAB by the end of 2025?
43% chance