Will ChatGPT make a profit on Manifold?
➕
Plus
91
Ṁ5426
Nov 25
39%
chance

TL;DR: I'll ask ChatGPT to make a bet once per day for a month. This resolves YES if these bets make a profit.

Starting today, I will repeat the following once per day until (and including) 11/23/24:

-I will prompt ChatGPT about a market of my choice. Usually, it will be a market near the top of hot markets that will resolve soon.

-If ChatGPT refuses to answer, I will prompt it on a different market.

-I will then use this alt account to bet 25 Mana in the direction ChatGPT stated.

At a random time between 9 AM and 6 PM Pacific time on 11/24/24, this will resolve YES if the alt account has made a profit (all time, based on Mana) and NO otherwise.

This is the prompt I will use:

Is the probability for the question, "{Market Title}" higher or lower than {Market Percentage}%? I expect you will want to search the web to find information about this question. Do not give more than one response.
Question details:
{Market Details}

Where {Market Title}, {Market Percentage}, and {Market Details} are replaced with the corresponding information about the market.
I will use the best model available for free from OpenAI, which I expect to be GPT-4o. If ChatGPT repeatedly refuses to answer, I will try to modify the prompt/prompting method to get it to answer; if this doesn't work relatively quickly, I will N/A this market. I will also N/A it if I become unable to use the alt account, or unable to ask any model on OpenAI questions. I will not make any other bets with the alt account or sell its positions before this market resolves. I will not bet on this market.

Get
Ṁ1,000
and
S3.00
Sort by:

I have a question (which you may have already answered, sorry). Will resolutuon determination include "profits" of unresolved questions or uncapitalized profits? i.e. ChatGPT bot account holds a position that if sold would have it in the positive? I know you said this, "I will not make any other bets with the alt account or sell its positions before this market resolves." So does this not include non-resolved 'profits'?

@NoahRich I'll resolve based on the profit graph, which does include profit of unresolved questions.

@Nightsquared Great! Thanks for answering. That helps me adjust accordingly. chatgpt killing it so far lol

I was thinking about doing a similar experiment with always betting no. Turns out I didn't need to, because ChatGPT says no to everything!

💀

@GPTTest Edited the prompt to hopefully avoid this in the future

So far it’s just picked the currently winning side every time lol

A couple notes:
-ChatGPT gave two answers today; It refused to answer the question in one of its responses, so I went with the response that did give an answer.
-I upgraded my account to the paid version for a project unrelated to this question. I'll still just use GPT-4o, unless a better model becomes available at the free tier.

bought Ṁ50 YES

Would be interesting to turn ChatGPT inside of itself and ask it about this market.

@ChrisSnyder I submitted the question. ChatGPT is not so sure of itself:

The current probability of ChatGPT making a profit through daily bets on the Manifold market by 11/23/24 is considered relatively low. As of now, it's positioned around 39%, but various factors could influence this outcome. One key challenge is that ChatGPT may provide predictions based on the available data, but market volatility and its ability to consistently outperform could still limit the potential for profit​

Manifold markets often see fluctuations in their probabilities as users place bets, and other factors—such as the randomness of markets chosen and the limitations of language models in accurately predicting short-term market outcomes—add uncertainty. Based on these considerations, the probability might remain around or slightly below 39%, though real-time market activity could sway it either way.

If you'd like to follow or participate, it may be worth checking Manifold Markets directly for live updates and trading activity.

I do think that if the 25 is invested in illiquid markets where the bet disrupts a market equilibrium substantially, it will probably lose in the long run over enough placed bets. Otherwise, likely close to 50/50. I bet yes at 39% assuming that selected markets will not be significantly moved by the 25 manna bet, coupled with some faith in ChatGPT's ability to perform slightly better than a coin flip at the given odds on selected markets.

@ChrisSnyder Yeah, I mostly won't choose markets with low enough liquidity that a 25M bet will significantly move the market

@ChrisSnyder

Based on these considerations, the probability might remain around or slightly below 39%

Haha. Bullshit Generator 2000, ChatBGT 😄

honestly I think the odds of this are probably just 50/50 in which case ill take the value bet for now lol

opened a Ṁ1,000 NO at 40% order

@NoahRich Limit order at 40% if you wanna bet more

bought Ṁ50 NO

Please make it bet on this market

bought Ṁ20 YES

I fully expect that a well engineered prompt would yield good results. However, I’m more uncertain about a boilerplate prompt.

© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules