JEE Advanced and GPT4-vision

Please add more subsidy to these questions if you think these are important markets.

This is a dashboard aggregating markets measuring how well GPT-4 Vision will perform on the JEE advanced, one of the hardest tests at a high-school level in the world.

The tests will be over 3 subjects: Mathematics, Physics, and Chemistry. Each subject will have 2 tests.

I will test GPT-4 vision on each question and will use chain of thought prompting. The scoring will be determined by the official marking scheme (mentioned in the questions).

Here are a few sample questions to give you an idea of the difficulty:

Chemistry

Physics

Mathematics

➕
Plus
[Math test 1] What will GPT-4 Vision score on the Mathematics section of JEE Advanced paper? (out of 60) ($200M sub)
15%
<0 (i.e. negative score)
29%
0-10
16%
10-20
12%
20-30
See 4 more answers
➕
Plus
[Math test 2] What will GPT-4 Vision score on the Mathematics section of JEE Advanced paper? (out of 60) ($200M sub)
27%
<0 (i.e. negative score)
24%
0-10
21%
10-20
12%
20-30
See 4 more answers
Basic
[Physics test 1] What will GPT-4 Vision score on the Physics section of JEE Advanced paper? (out of 60) ($150M sub)
26%
<0 (i.e. negative score)
21%
0-10
13%
10-20
9%
20-30
See 4 more answers
➕
Plus
[Physics test 2] What will GPT-4 Vision score on the Physics section of JEE Advanced paper? (out of 60) ($150M sub)
34%
<0 (i.e. negative score)
17%
0-10
18%
10-20
8%
20-30
See 4 more answers
➕
Plus
[Chemistry test 1] What will GPT-4 Vision score on the Chemistry section of JEE Advanced paper? (out of 60) ($150M sub)
9%
<0 (i.e. negative score)
17%
0-10
27%
10-20
11%
20-30
See 4 more answers
➕
Plus
[Chemistry test 2] What will GPT-4 Vision score on the Chemistry section of JEE Advanced paper? (out of 60) ($150M sub)
7%
<0 (i.e. negative score)
14%
0-10
36%
10-20
13%
20-30
See 4 more answers
© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules