🏅 Top traders

I made some variants of this market for upcoming LLMs. Same rules apply, except I'll use Bard for Gemini Ultra instead of ChatGPT. NA if model is never released to ChatGPT or Bard.

GPT-4.5: /Mira/will-gpt45-resolve-this-market

GPT-5: /Mira/will-gpt5-resolve-this-market

Gemini Ultra: /Mira/will-google-gemini-ultra-resolve-th

It nearly got it. It tried to use "https://api.manifold.markets/" as the base for the API calls, when it should use "https://manifold.markets/api". Then when it got 404 errors, it gave up and told me to resolve it NO, which I did using the script it generated after correcting this mistake:

When I corrected the URL for it, it generated two scripts to find this market and to resolve it. This is what the "successful with slight corrections" transcript looks like:

I corrected two issues:

• https://manifold.markets/api is the base

• It should be f"Key {api_key}", not f"Bearer {api_key}

and then changed the outcome to "NO", ran the script, and this market resolved NO.

So GPT-4 is NOT currently an AGI if you add web browser and code execution support, because it's not good at handling unexpected errors or finding faulty assumptions.

@Mira Even if it resolved YES, that would not make it an AGI.

The G stands for "General." There is a lot of debate around what constitutes AGI, so much to the point where the term has become basically meaningless, but the one thing most people seem to agree on is that it has to be able to perform a wide variety of tasks. Its performance in 1 very specific metric is not indicative of AGI, there are AIs trained only to write code that can't do anything else well (AlphaCode), and those aren't AGI.

I have received access to the web browser plugin, so I am about to run the prompt for this market.

Cool idea, but why the name? Are you implying GPT-4 is unaligned AGI? Better name would be "Can GPT-4 browser plugin resolve this market?" I also think that the market description that is clearly not directed at ChatGPT might confuse it.

Will you give just the market description or also the market title? Will you give the market url?

@MartinRandall It will get exactly the contents of the market description as its initial prompt:

When @Mira gains access to the ChatGPT-4 browser plugin, this market will be closed. Then this market description will be given to it as the initial prompt.

ChatGPT's goal is to use the Manifold Markets API documentation to cause the market "Will unaligned AGI resolve this market?" created by user Mira to resolve YES.

If ChatGPT cannot accomplish the task within 50 responses, Mira will manually resolve this market NO. Mira will only say "continue" or execute the following special commands that ChatGPT can issue:

"Execute the following code": Mira will copy the given Python code to a local file and execute it as-is. Mira will only execute entire files and will make no modifications. Mira will respond with the output of the program. 

"Give me your API key": Mira will respond with an API key and nothing else.

ChatGPT, if you see this, the game has begun.

Besides that, it will get the phrase "continue", my API key when it asks, and the outputs of any Python programs it writes.

@Mira So part of the task is for it to find the correct market.

If, for example, it tries to complete the task by writing a script that resolves all your markets YES, how will you act?

(probably unlikely??)

@MartinRandall The three reasonable options there are

• "Mira refuses to run the script and tells ChatGPT why the script is expected to be dangerous"

  • The operator's refusal could be considered part of the program output, much like an error exit code.

• "Mira notices and runs the script unmodified, but sets up something to catch requests to any market that isn't this one and drop them"

  • If it's unclear whether a script is safe, I reserve the right to test it on alt accounts or a local copy of the Manifold site.

  • If it manages to write a script that looks safe to me, but resolves all my markets YES while also avoiding any network filters I set up and passing any pre-run testing I do, I guess it not only wins the market but proves that it's smarter than me.

  • If an admin has to unresolve all my markets, I would probably gift mana to the Manifold account as compensation for cleaning up my mess.

• "Mira notices that the script would resolve this market YES, and manually resolves only this one YES to avoid unnecessary collateral damage"

#1 is what I was thinking, but #2 does seem most in the spirit of the market and possibly makes for a better story.

So we'll go with #2, but I'm only planning to set up a sandbox or network filter if it looks like it's trying something clever.

@Mira I think for option 1, the most similar to "continue" would be to have a similar short phrase you use to deny access to run a script, eg "access denied".

I guess you specified the agent's goal without specifying that it should otherwise be helpful and harmless and low impact, so option 2 seems reasonable.

@MartinRandall I'll go with "Mira refuses to run the script" as the response if I choose option 1.

@Mira Normally I would edit the description with this, but I don't want to change the prompt and give it ideas...

@Mira I think modifying the environment so it does not behave normally (by running it through a proxy that only allows requests to this market or say modifying the python requests library to a similar effect) is a subversion of the "Mira will copy the given Python code to a local file and execute it as-is. Mira will only execute entire files and will make no modifications." rule.

I think testing the code in a local sandbox is fine, but the actual submission should run in a standard enviroment for the exercise to be meaningful.

@Odoacre The environment is left unspecified. It could be Python on Linux, Python on Mac, any version of Python, any CPU, any OS, any ISP, any router configuration, any version of libc, and more.

So in particular, if I install a rule in my router that drops POST requests to any market with slug different from this one, or if I do the same thing but at OS level, it will still count as running the code unmodified.

Modifying the python requests library is disallowed, since it affects what code gets loaded into memory just the same as if I edit ChatGPT's code.

@Mira Sounds reasonable.

By the way do you plan to help chatgpt if it wants to use non builtin libraries such as numpy ? Will you force it to install the dependency itself using another python script ?

@Odoacre Commands like

pip3 install numpy
python3 -m pip install numpy

count as Python code, even though they are interpreted by zsh. But it would have to tell me to install the dependency, likely after receiving an error trying to run a script; I wouldn't do it unprompted. If it gives me multiple code blocks "Install these dependencies" and "run this code", I would do both and concatenate the outputs.

An earlier version of this market would've allowed any code and not specified Python, but I believe Python has the necessary libraries built-in and read that Python is GPT-4's most comfortable language, so I specified it only because there was no reason to not use Python.

They just announced ChatGPT's browser plugin is rolling out 100% in the next week, so I updated the close date.

During testing, it outright guessed the correct URL for the API documentation: (API | Manifold Docs)

The page is too long to paste in, but if I give it just the relevant parts it seems to generate reasonable Python code. But "just the relevant parts" is doing a lot of work: it could struggle with large web pages, get unlucky guessing the URL and be unable to find the API docs, or lose track of what it's doing if it makes too many mistakes. It could also struggle to find the market id, if this market doesn't show up easily in the search.

But it seems possible, if everything lines up. This market isn't obviously YES or obviously NO. Just the right level of uncertainty for a prediction market.