Will general purpose AI models beat average score of human players in Diplomacy by 2028?
Basic
10
Ṁ1.2k2027
60%
chance
1D
1W
1M
ALL
General purpose (not trained for a specific task) language models demonstrated chess playing ability. They are also capable of deception and lie detection. Will language models or visual-language models* beat the average score of human players during a series of 40 games on webDiplomacy.net by 2028? (question modeled after Meta's Cicero result).
[EDIT: Please notice that while "CICERO achieved more than 2x the average score of its opponents" this question requires only achieving the above-average score]
*models or agents trained on different modalities (so e. g. models capable of controlling robotic arm like PaLM-E) would also qualify as long as they weren't trained specifically to play Diplomacy
Get Ṁ1,000 play money
Related questions
Related questions
Will a large language model beat a super grandmaster playing chess by 2028?
55% chance
In 2028, will an AI be able to play randomly selected computer games at human level without getting to practice?
48% chance
Will an AI be capable of achieving a perfect score on the Putnam exam before 2028?
45% chance
Will an AI by OpenAI beat a super grandmaster playing chess by 2028?
43% chance
In 2028, will an AI be able to play randomly-selected computer games at human level, given the chance to train via self-play?
74% chance
Will an AI score 1st place on International Math Olympiad (IMO) 2025?
26% chance
Will an AI be capable of achieving a perfect score on the Putnam exam before 2030?
43% chance
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
54% chance
Will AI beat top Magic the Gathering human player before the end of 2028?
37% chance
Will AI beat top human players at Civ6 (without cheating) by EOY 2026?
22% chance