JEE Advanced and GPT4-vision

Please add more subsidy to these questions if you think these are important markets.

This is a dashboard aggregating markets measuring how well GPT-4 Vision will perform on the JEE advanced, one of the hardest tests at a high-school level in the world.

The tests will be over 3 subjects: Mathematics, Physics, and Chemistry. Each subject will have 2 tests.

I will test GPT-4 vision on each question and will use chain of thought prompting. The scoring will be determined by the official marking scheme (mentioned in the questions).

Here are a few sample questions to give you an idea of the difficulty:

Chemistry

Physics

Mathematics

15%
<0 (i.e. negative score)
29%
0-10
16%
10-20
12%
20-30
27%
<0 (i.e. negative score)
24%
0-10
21%
10-20
12%
20-30
26%
<0 (i.e. negative score)
21%
0-10
13%
10-20
9%
20-30
34%
<0 (i.e. negative score)
17%
0-10
18%
10-20
8%
20-30
9%
<0 (i.e. negative score)
17%
0-10
27%
10-20
11%
20-30
7%
<0 (i.e. negative score)
14%
0-10
36%
10-20
13%
20-30