Will GPT-5 be more competent than me in my area of expertise?
Will GPT-5 be more competent than me in my area of expertise?
30
1kṀ725
Dec 31
44%
chance

Will replies to ten well-engineered GPT-5 prompts in my area of expertise outperform my own answers to them?

Example of what I mean by a well-engineered prompt:
"The following is an excerpt from the 'Guyton & Hall' authoritative textbook on human physiology. It describes the respective roles of RAAS, ANP, and ADH in controlling plasma osmolality and free water clearance through their effects on renal tubular transport."
Currently, I find ChatGPT's and GPT3's answers to questions of this complexity to sound convincing. However, when examined more closely they turn out to be factually wrong and inconsistent often enough to be useless.


Resolves N/A if there is nothing that can reasonably be called GPT5.
Resolution based on the best judgment of a friend of mine who has tech expertise yet enough understanding of biomed sciences to be able to competently judge. (I was convinced that I might be biased, so I changed this from me resolving it based on my own best judgment.)

Since I will base my future use of GPT for study purposes on its performance relative to myself, I am incentivized to judge as truthfully as possible.

Get
Ṁ1,000
to start trading!


Sort by:
2y

More competent as in "it's a more comprehensive knowledge database", or "it can reason and make new discoveries as well as me"?

2y

related market

2y

I would bet YES if it was being evaluated by a neutral third party, but I don't generally trust people to evaluate themselves against AI (no offense), even with some incentive to do so.

2y

@vluzko Fair enough, do you think this would be better if I ask a friend of mine who has tech expertise yet enough understanding of biomed sciences to be able to competently judge?

2y

@elibutchad I think that would be better, yes

2y

@vluzko Alright, I will change the resolution criteria later today.

2y

I wish I could bet "this will resolve N/A" without having to make a market myself

2y

@L you do not think there will be a GPT-5 or you think that the resolution criteria are too murky? Help me improve this if it's the latter.

2y

related (same question but for GPT4)

What is this?

What is Manifold?
Manifold is the world's largest social prediction market.
Get accurate real-time odds on politics, tech, sports, and more.
Or create your own play-money betting market on any question you care about.
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like betting still use Manifold to get reliable news.
ṀWhy use play money?
Mana (Ṁ) is the play-money currency used to bet on Manifold. It cannot be converted to cash. All users start with Ṁ1,000 for free.
Play money means it's much easier for anyone anywhere in the world to get started and try out forecasting without any risk. It also means there's more freedom to create and bet on any type of question.

Related questions

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules