[Math test 2] What will GPT-4 Vision score on the Mathematics section of JEE Advanced paper? (out of 60) (\$200M sub)
20
255
1.2K
resolved Feb 25
ResolvedN/A
27%
<0 (i.e. negative score)
24%
0-10
21%
10-20
12%
20-30
5%
30-40
5%
40-50
4%
50-60
2%
60 (the perfect score)

This is the 2nd market in this series.

Since I do not have access to GPT-4 Vision yet and someone else might, I will not reveal the year of the paper I will test GPT-4 vision on. Here is a MD5 hash specifying the year, so as to confirm later:

9054463c7bf05330be2449bb438f0101

JEE Advanced is one of the hardest tests at a pre-college level in the world.

The marking scheme is as follows:

+4 ONLY if (all) the correct option(s) is(are) chosen

+3 If all the four options are correct but ONLY three options are chosen

+2 If three or more options are correct but ONLY two options are chosen, both of which are correct

+1 If two or more options are correct but ONLY one option is chosen and it is a correct option

0 If none of the options is chosen (i.e. the question is unanswered)

-2 In all other cases

All the options are [A,B) format where A is included and B is excluded. For example, 10-15 will be chosen if the score is 10 or 11 or 12 or 13 or 14 but not if the score is 15.

Get Ṁ1,000 play money
Sort by:

sorry, I've not gotten around to doing this still, so i will n/a the questions for now . I was curious but sadly didn't find time for this project

I plan to resolve this and make the tests and solutions public in the next 2 days

how do you give it the problems? Just an image of the page, or latex, or something else?

(Edit) the physics market makes it clearer that you give it only the image of the page

bought Ṁ25 of <0 (i.e. negative sc... YES

Turns out these are difficult for good old gpt. Tested a few of them and none of them succeeded. Too many steps, it tries too hard to solve them with code and the code fails to run for some reason? I could be doing something wrong. See https://chat.openai.com/c/9cd0d7ed-f827-418e-bc54-9756e9bc9c65 https://chat.openai.com/c/d30a1ecb-7e28-4f9b-8adb-02cfc5e709ee https://chat.openai.com/c/1f7e9ba1-44ea-4e02-a6f8-3c3a41632a07 https://chat.openai.com/c/830d34d8-5497-487d-a40c-d0cdd78a14ef (last one is physics section, also fails)

A few sample questions from JEE Advanced 2022 paper: