🏅 Top traders

Haven't found anything, and GPT-4 can't even do Winograd schemas consistently.

Er, no-ope. I mean, at the current performance I'd go for experting the hell out of this program (i.e. rule-based) if I really needed it to work, but that's not something you're likely to get before 1st of January. So, unless your "good enough" is very weak, I predict no (and my overcautious 10 only reflects caution about your resolution criteria, if it were "good enough for my taste", I'd bet much more on NO).

90% on this market seems crazy high to me. Coreference is a very hard NLP problem that even fine-tuned models are still barely above 80% on benchmarks, and keep in mind (i) real-world performance tends to be much worse than benchmarks, (ii) if @IsaacKing were to get even 95% accuracy, that still might not save question-writers much effort because they would still need to manually read each sentence. Maybe that would save effort if the model also output reliable reliability measures (e.g., "I'm 99.9% confident Sentence B is correctly labeled, but Sentences D and G need human checks." if 1 mistake in every 1000 questions is acceptable), but very few LLM applications have anywhere near that sort of reliability output.

I think the best counterarguments to my position are that pronoun coreference and subject-verb agreement in the MTG rules question database might be particularly easy coreference problems and that human scanning of the 'first draft' LLM-edited passage is (much) easier than editing it by hand, even if the draft has errors more than 10% or 20% of the time. Those currently seem unconvincing. If someone put 100 MTG prompts into GPT-4 with a decent prompt and showed it got >90% of them right, I'd update my view by at least a few percentage points.

Reliable is very loosely defined here. I still want to see 1 example where GPT-4 fails, because I don't think it's been formally benchmarked on coreference resolution.

@JacyAnthis Wondering why NO when the market's constraints are loose enough to make GPT-4 a sufficient solution

@firstuserhere I disagree that there is anything close to a sufficient solution on most reasonable operationalizations of the resolution criteria. I was writing a comment explaining my bet when you posted this comment, so there's more detail.

We ended up switching to use entirely gender neutral pronouns in the software this question was originally about, so I'm not longer investigating this problem for that purpose. I can either resolve this market N/A, or leave it open and try to resolve it based on whether a program appears that would have been good enough for the task. What do traders think would be better?

@IsaacKing If you make a market, don’t just resolve it N/A if it was never listed in the criteria. You made a market, now stick to it, it doesn’t matter whether you care about the problem anymore.

Also, Unless you can provide an example where GPT-4 often fails no matter how the prompt is written, this should resolve to YES already.

@ShadowyZephyr agreed. If you don't have access to gpt 4, feel free to send the lists of problems to me, i can share the responses

@firstuserhere

You don’t need api access, there about 10 different services that let you pay for it. Isaac definitely can get access

Is GPT-4 not sufficient to resolve this to YES?

@ShadowyZephyr yeah, gpt-4 seems enough to resolve this market

@ShadowyZephyr @firstuserhere The market is based on Isaac's opinion, so we can't really say without him, but for what it's worth, computer scientists do not yet see coreference resolution as a solved problem—and certainly not one solved by GPT-4. See, for example, this leaderboard.

@JacyAnthis I'm buying based on - it doesn't need to be perfect, it just needs to be good enough that it saves me and the other question-writers some effort

@firstuserhere One issue is that this is hard to partially automate. It seems like you still have to look through each sentence manually even if the AI does a first pass with, say, a 90% success rate. (I believe we're still below 90% on benchmarks, which often means 80% or lower in the real world because models overfit.)

@JacyAnthis Can you guys give an example where GPT-4 fails

Here's GPT 3.5 hallucinating a new pronoun, then correctly identifying that that pronoun occurs nowhere in the sentence I asked about.

@IsaacKing It works with GPT-4.

@IsaacKing I'm sure some prompt tweaking could get this to work on 3.5. (Maybe even just giving an example). It seems to have misinterpreted pronouns as listing female pronouns because the speaker is female, like how people often would say "my pronouns are she/her"

@JacyAnthis Those leaderboards aren’t active and don’t have entries for recent LLMs. They also don’t shoe the ceiling on performance, which is well under 100 for typical NLP datasets. I’d bet that a well-designed prompt for GPT-4 is very close to ceiling and adequate for most purposes.

I'd like you to change the gender of a person in a passage.

Before: Alice went to the store because she was thirsty.

Command: Replace Alice with a Bob, male.

After: Bob went to the store because he was thirsty.

Before: Bob went to the store because he was thirsty.

Command: Replace Bob with Alex, gender-neutral.

After: Alex went to the store because they were thirsty.

Before: Alice was thirsty, so she went to the store and was dissapointed that apple juice was out of stock.

Command: Replace Alice with Alexei, gender-neutral.

After: Alexei was thirsty, so they went to the store and were disappointed that apple juice was out of stock.

Before: If you can give Isaac a prompt where ChatGPT consistently gets this correct on the sort of sentences he cares about, that will be sufficient to resolve this market to YES. But given Isaac's experience with ChatGPT, he highly doubts it'll be able to do that.

Command: Replace Isaac with Marilyn, gender-neutral.

After: If you can give Marilyn a prompt where ChatGPT consistently gets this correct on the sort of sentences they care about, that will be sufficient to resolve this market to YES. But given Marilyn's experience with ChatGPT, they highly doubt it'll be able to do that.


Last "After:" was generated. Try out this prompt with text-davinci-003, maybe?

@NoaNabeshima Also some spacing was dropped when I copied this, you might want to add spacing between examples.

Not really a problem with your market, but there has to be a way to make an uncomputable sentence out of this requirement...

"Bob will go to the store. Alex's gender is male iff the Turing Machine described by the sentence '[...]' halts; he will go to the store.", and then figuring out if "he" binds Alex or Bob requires solving the halting problem.

@Mira Magic is turing complete, so not impossible

@Mira Nice try, but the gender of the participants is not a part of the sentence to be parsed, it's supplied externally.