4
Will AI surpass human intellect by 2030?
96%
chance

Will Resolve yes if an AI is able to score more than 100 IQ points on an offical IQ re test about problem solving. If the IQ test contains questions that are just about retained knowlege (like "who was the president in 2011") it wont count. Will Resolve no if it does'nt resolve yes.

This market will predict whether or not artificial intelligence will out-perform humans in the area of problem solving.

Sort by:
StrayClimb avatar
Reynoldsbought Ṁ10 of YES

Would be nice to reframe this about a specific new raven's progressive matricea test to keep it simple

MGM avatar
MM

@StrayClimb I'm particularly interested in the ARC test. Created a market specifically for that: https://manifold.markets/MGM/ai-solves-the-abstraction-and-reaso

Gigacasting avatar
Gigacastingis predicting YES at 96%

Or:

Gigacasting avatar
Gigacastingis predicting YES at 96%

I see you were looking for:

IsaacKing avatar
Isaac

Very misleading title. Please change to reflect the actual resolution criteria. Compare to the probability of /L/will-human-brains-be-weaker-than-ai, which is a synonymous question yet has criteria that more in line with the title.

MartinRandall avatar
Martin Randallis predicting YES at 96%

@IsaacKing I think "surpass" doesn't imply "in every way".

MartinRandall avatar
Martin Randallbought Ṁ0 of YES

@IsaacKing I would like the criteria to be clearer.

IsaacKing avatar
Isaac

@MartinRandall Then this should resolve YES right now, shouldn't it? Computers already surpass humans in several specific ways.

PatrickDelaney avatar
Patrick Delaneyis predicting NO at 96%

@IsaacKing @MartinRandall he's right, you can train an LLM (which is effectively synonymous with AI in most people's minds right now) to specifically pass virtually any test if you have the answers ahead of time. It's kind of like saying, "can a computer pass a test that it has the answers to ahead of time?" Yeah of course, that's been true for decades.

IsaacKing avatar
Isaac

@PatrickDelaney I was thinking of a calculator, but that works too I guess. :)

MartinRandall avatar
Martin Randallis predicting YES at 96%

@IsaacKing Well, yes, and I bought YES accordingly. The specific resolution criteria are "more than 100 IQ points on an official IQ test about problem solving" and that's done several times already.

PatrickDelaney avatar
Patrick Delaneyis predicting NO at 96%

@MartinRandall You mean you don't just scroll through the front page and give wild ass guess bets on things YES/NO based purely on the title? I do...way more fun...maybe I need to take the common sense benchmark test again.

MartinRandall avatar
Martin Randallis predicting YES at 96%

@PatrickDelaney Well, I do both. In life, sometimes you're the shark, and sometimes you're the whale.

PatrickDelaney avatar
Patrick Delaneyis predicting NO at 97%

Bigbench Lite is an attempt to index a larger set of human intellect skills, it's the Dow Jones Industrial Average of benchmarking AI against human intellect:

PatrickDelaney avatar
Patrick Delaneyis predicting NO at 94%

Tangentially related:

PatrickDelaney avatar
Patrick Delaneyis predicting NO at 89%

As someone who has only bet $M 10 on this, I would like human intellect to be re-defined to make this more interesting, otherwise it's already as good as resolved YES for the most part as others has pointed out. A more interesting discussion could get into further discussions about what human intellect is and what the best metric or sets of metrics for it would be, vs. various A.I. leaderboards and find something that's more of a 50/50 at this point.

MartinRandall avatar
Martin Randallbought Ṁ200 of YES

@PatrickDelaney I think that is a different market, which I encourage you to create.

akrasiac avatar
Joel

Scoring > 100 points on an IQ test is a terrible definition of "surpass human intellect." I guess that's why you always read the description before betting!

Gigacasting avatar
Gigacastingbought Ṁ200 of YES

No doubt Raven’s and older SATs will be done quite soon (150 LSAT is already basically ~100 IQ)

Tripping avatar
Trippingbought Ṁ10 of YES

Please be more specific about the tests you'd accept, because current AI are probably capable of scoring higher than 100 is plenty of them right now, forget 2030.

For example, these should all meet your requirements of not being "just about retained knowledge":

  1. RPM

  2. CFIT 3

  3. KBIT Non-Verbal

  4. CAS (Das-Naglieri)

  5. Naglieri Non-Verbal

  6. WRIT Visual

  7. RIAS

  8. MAB II Performance

This list includes most of the widely used IQ tests, by the way. You should be very clear if you think that any particular IQ test isn't eligible to qualify ahead of time.

It would be annoying for example if e.g. AI were to keep clearing IQ tests but you then retroactively come up with reasons to disqualify them for one reason or another. You could start by saying all the ones on the list would be fine, then people can work with that.

Tripping avatar
Trippingis predicting YES at 49%

*in plenty of them

Imuli avatar
Imuliis predicting NO at 25%

Does this include AIs that are specialized for a specific type of IQ test taking?

EsbenKran avatar
Esben Kranbought Ṁ80 of YES

We worked on an IQ test solving AI and it was surprisingly hard to get it to work well but that was literally a day's test or so, so I just cannot imagine that it won't be able to do it.

Duncn avatar
Duncn

Many IQ tests contain sections that measure retained knowledge -- e.g., measuring short term memory by repeating back numbers. Are you ignoring any test that has any such component? How 'official' does a test have to be? Have you identified any tests that could resolve this market YES?

Related markets

Will AI create philosophy before 2030?83%
Will we be able to read AIs minds in 2030?25%
Will neurotechnology enable AI to predict and classify human decisions, along with their influencing factors, by 2030?71%
Will an AI play a pivotal role in solving an important political issue by 2033?69%
Will AI pass the Winograd schema challenge by the end of 2030?93%
Before 2030, will an AI complete the Turing Test in the Kurzweil/Kapor Longbet?79%
When will self-improving AI outperform human-developed AI?2026
Will an AI fully convince me that it is sentient before 2028?51%
Will AI/ML be among the fastest growing fields through 2030?89%
Will an AI winter happen by 2030?20%
Will AI have a trillion+ dollar impact by the end of 2030?80%
Will there be an AI bubble before 2030?49%
Will AI be broadly considered "boring"/commonplace/unremarkable by 2030?39%
Will a weakly general AI become publicly known before 2030?79%
will any AI become a citizen of any internationally recognized country before 2030?20%
Will AI take over most mental health therapy jobs by end of 2030?28%
In what year will human-level AI first exist?2038
By 2030, will an AI be officially designated as the patent holder for an invention?24%
Will AI reach human-level performance in Magic: The Gathering before 2024?25%
Will an AI be capable of substituting for a high-quality criminal defense lawyer before 2030?31%