JEE Advanced and GPT4-vision

Please add more subsidy to these questions if you think these are important markets.

This is a dashboard aggregating markets measuring how well GPT-4 Vision will perform on the JEE advanced, one of the hardest tests at a high-school level in the world.

The tests will be over 3 subjects: Mathematics, Physics, and Chemistry. Each subject will have 2 tests.

I will test GPT-4 vision on each question and will use chain of thought prompting. The scoring will be determined by the official marking scheme (mentioned in the questions).

Here are a few sample questions to give you an idea of the difficulty:

Chemistry

Physics

Mathematics

Plus

[Math test 1] What will GPT-4 Vision score on the Mathematics section of JEE Advanced paper? (out of 60) ($200M sub)

15%

<0 (i.e. negative score)

29%

0-10

16%

10-20

12%

20-30

See 4 more answers

Plus

[Math test 2] What will GPT-4 Vision score on the Mathematics section of JEE Advanced paper? (out of 60) ($200M sub)

27%

<0 (i.e. negative score)

24%

0-10

21%

10-20

12%

20-30

See 4 more answers

Basic

[Physics test 1] What will GPT-4 Vision score on the Physics section of JEE Advanced paper? (out of 60) ($150M sub)

26%

<0 (i.e. negative score)

21%

0-10

13%

10-20

9%

20-30

See 4 more answers

Plus

[Physics test 2] What will GPT-4 Vision score on the Physics section of JEE Advanced paper? (out of 60) ($150M sub)

34%

<0 (i.e. negative score)

17%

0-10

18%

10-20

8%

20-30

See 4 more answers

Plus

[Chemistry test 1] What will GPT-4 Vision score on the Chemistry section of JEE Advanced paper? (out of 60) ($150M sub)

9%

<0 (i.e. negative score)

17%

0-10

27%

10-20

11%

20-30

See 4 more answers

Plus

[Chemistry test 2] What will GPT-4 Vision score on the Chemistry section of JEE Advanced paper? (out of 60) ($150M sub)

7%

<0 (i.e. negative score)

14%

0-10

36%

10-20

13%

20-30

See 4 more answers

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules