Will any model pass an "undergrad proofs exam" Turing test by 2027?
20
1kṀ987
2027
79%
chance
The model receives each question as text (or text + images), outputs an answer as text + images, and is graded as part of a pool with human students who also took the test. "Pass" means >=70% Has to be a proofs-based exam, e.g. abstract algebra, topology, linear algebra if it's proofs heavy. There are probably undergrad math exams *somewhere* that are very easy, so I will be exercising my judgment on whether the exam "counts". Unfortunately I do not have examples to hand of what I consider reasonable, but something like "would be a medium difficulty 200-level proofs exam at a top-tier university".
Get
Ṁ1,000
to start trading!
© Manifold Markets, Inc.TermsPrivacy