
Will PaLM 2 be widely considered better than GPT-4 by August?
17
330Ṁ1731resolved Aug 1
Resolved
NO1H
6H
1D
1W
1M
ALL
If no one recommends anything that captures the title's intention better, resolution will be based on https://github.com/FranxYao/chain-of-thought-hub
Specifically - if on August 1st one of the PaLM 2 models has at least 3 scores better than GPT-4, and has at least twice as many scores better than GPT-4 than worse, this market resolves YES. Otherwise, assuming no major contention, resolves NO.
In other words - unless the current PaLM 2 benchmarks are wrong somehow and better ones come out, this will resolve NO.
I will use the same criteria for
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
🏅 Top traders
# | Name | Total profit |
---|---|---|
1 | Ṁ57 | |
2 | Ṁ37 | |
3 | Ṁ18 | |
4 | Ṁ15 | |
5 | Ṁ14 |
People are also trading
Will there be an open source LLM as good as GPT4 by June 2024?
12% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
83% chance
Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?
13% chance
Is GPT-4 best? (Thru 2025)
63% chance
Sort by:
this isn't a resolution criteria but https://old.reddit.com/r/MachineLearning/comments/13e1rf9/d_since_google_buried_the_mmlu_benchmark_scores/
People are also trading
Related questions
Will there be an open source LLM as good as GPT4 by June 2024?
12% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
83% chance
Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?
13% chance
Is GPT-4 best? (Thru 2025)
63% chance