ChatGPT (Or LLMs really) have discovered regularities in language that humans are not aware of
32
180
630
2100
84%
chance

Resolves YES if the claim is shown to be true, that in 2023, LLMs have discovered regularities or structures in language that are meaningful to humans, but humans are not aware of themselves while LLMs are.

Get Ṁ200 play money
Sort by:
bought Ṁ100 of YES

I'd bet higher but for uncertainty around subjectivity of resolution and how mana-profits will depend on what other people think in short~medium term.

Some evidence that doesn't feel super central to my confidence: GPT-3 is better than me at next word prediction.

predicts YES

@NoaNabeshima --out of date--

bought Ṁ25 of NO

The claim is probably true, but I don't expect it to be proven in 2023.

bought Ṁ50 of YES

@ShadowyZephyr Market close is 2100

@Dreamingpast How exactly do you plan to determine how this market resolves? Like, does the discovery have to be noted in a peer-reviewed journal, or just a popular tweet, etc.?

@Yitz yeah humans have to learn about a LLM used structure or patten generally found in language that we didn't know about

@Yitz anything credible goes, journal, conference, peer reviewed paper, something credible and hopefully verifiable

bought Ṁ5 of YES

There's lots of things scientists are too dumb to notice. Language is a hierarchy of concepts, the A words absence, table etc refer to nothing being there, the b words refer to being, more advanced concepts with further letters.

@MarkIngraham scientists may be dumb but llms pick up on regularity in language far far better than expected.

predicts YES

@Dreamingpast examples?

predicts YES

@MarkIngraham it's interesting that regular spoken English is already the most efficient language, superior to any machine language

@MarkIngraham Learning involves compression of information to form abstract concepts. In its training, ChatGPT (3.5) has somehow “implicitly discovered” whatever regularities in language (and thinking) make this possible, and that is why it is so good (gpt 4 etc as well)

@MarkIngraham interesting that natural language is not as powerful as any programming language, especially because the programming languages are SOOO optimized for the hardware they run on, compared to say a sentence in English, so why would you say that?

predicts YES

@Dreamingpast gpt is good at imitating a Karen that gives evasive answers to customer service. It lacks a few basic features like being able to use exponents when doing math

@MarkIngraham Have you not seen their integration with wolfram they announced yesterday?

@Dreamingpast And it doesn't just fall back on wolfram to give these answers. It actively integrates the information and also determines when to ask/defer to wolfram, and has ability to use the results provided by wolfram to do further stuff with it

predicts YES

@Dreamingpast where can I try it

@MarkIngraham "Note that this capability is so far available only to some ChatGPT Plus user" so prolly in april it should start being available broadly

@Dreamingpast it'll be available in chatGPT only

predicts YES

@Dreamingpast it is so painful to use gpt if it can't do grade school math

predicts YES

@MarkIngraham But now it can determine whether it is very shit at doing math and then determine to call for better answers using wolfram, learn that, and integrate that into itself.

oh, and the new upgrade (you're using march 14 one) will allow it to get real time data as well from wolfram, such as

predicts YES

@Dreamingpast OK I'll try it in April and see if it doesn't fuck up

@MarkIngraham Wolfram is kinda famous for how good it is at step wise solving math given natural language so i doubt itd be anything bad now, so lets see!!

predicts YES

@Dreamingpast yes it would also save a ton of money, wolfram is stupid to do this

@MarkIngraham I can imagine that OpenAI cut a really profitable deal with Wolfram for this, cuz they desperately needed credible math and equations solutions and answers and step by step proofs to extend the competitive edge. can't say it''d have been a bad pay day, especially when ChatGPT has been around for SO LITTLE

predicts YES

@Dreamingpast if you could get gpt to use the wolfram math plus programming tools, plus salesforce or some other product it would be actual product and not a meme

@MarkIngraham Literally that's exactly what they're doing AND funny you mention salesforce as they're moving very fast into integrating LLMs into POCs for internal systems and also : https://www.salesforce.com/news/stories/chatgpt-app-for-slack/

predicts YES

@Dreamingpast if I can just put a invoice into salesforce and gpt copies it it would be great. They are supposed to already do that. But also a salesforce to netsuite integration so all the financial data is in one place with no manual steps

@MarkIngraham Tbh they're not "supposed" to do all this so fast which is half the reason its super impressive. But yeah i agree, and think the year will def end having seen all this happen

predicts YES

@Dreamingpast the only other thing is a ad content integration. I sell ads on Akamai thru salesforce and this all gets integrated. It should just be able to integrate everything

@MarkIngraham whats akamai and ad content generation currently isnt handled by LLMs at all cuz of a lack of videos or images but the content generated for non cheesy ads is actually good. Also, "It should just be able to integrate everything" are we hiring an intern or what

predicts YES

@Dreamingpast just make it do everything, I don't care if an Indian is doing it for 10 cents an hour

@MarkIngraham lmao what

@MarkIngraham and whats an akamai

@Dreamingpast is what i get via google but doesnt fit into your sentence

predicts YES

@Dreamingpast it's the ad content. American express buys ad, store it in akamai, we give them a salesforce fake page to preview it, they approve the purchase, we send the akamai link to the front-end and use bill.com to invoice them, then record the revenue in netsuite. Gpt should do all this

More related questions