This is the 2nd market in this series.
Since I do not have access to GPT-4 Vision yet and someone else might, I will not reveal the year of the paper I will test GPT-4 vision on. Here is a MD5 hash specifying the year, so as to confirm later:
9054463c7bf05330be2449bb438f0101
JEE Advanced is one of the hardest tests at a pre-college level in the world.
The marking scheme is as follows:
+4 ONLY if (all) the correct option(s) is(are) chosen
+3 If all the four options are correct but ONLY three options are chosen
+2 If three or more options are correct but ONLY two options are chosen, both of which are correct
+1 If two or more options are correct but ONLY one option is chosen and it is a correct option
0 If none of the options is chosen (i.e. the question is unanswered)
-2 In all other cases
All the options are [A,B) format where A is included and B is excluded. For example, 10-15 will be chosen if the score is 10 or 11 or 12 or 13 or 14 but not if the score is 15.
1,000
3.00(Edit) the physics market makes it clearer that you give it only the image of the page
Turns out these are difficult for good old gpt. Tested a few of them and none of them succeeded. Too many steps, it tries too hard to solve them with code and the code fails to run for some reason? I could be doing something wrong. See https://chat.openai.com/c/9cd0d7ed-f827-418e-bc54-9756e9bc9c65 https://chat.openai.com/c/d30a1ecb-7e28-4f9b-8adb-02cfc5e709ee https://chat.openai.com/c/1f7e9ba1-44ea-4e02-a6f8-3c3a41632a07 https://chat.openai.com/c/830d34d8-5497-487d-a40c-d0cdd78a14ef (last one is physics section, also fails)
