Will we have a reliable detector software to differentiate between LLM generated and human generated text by 2023 end?
65
174
แน€1.7K
resolved Jan 1
Resolved
NO

Resolves N/A if already happened. But i don't think it has. Everything I've tried so far gets no better than 20-30%.

Prefer to have something i can try myself and check.

Get แน€200 play money

๐Ÿ… Top traders

#NameTotal profit
1แน€272
2แน€79
3แน€22
4แน€18
5แน€15
Sort by:

Operationalize reliable please :)
e.g. which LLMs detecting, what text is being generated, required sensitivity/specificity/false positives/negatives etc

@CalebWithers I'd definitely bet no if it involves detecting general more generally (i.e. not constrained to certain types of prompts, tasks, or models)

bought แน€10 of NO

Key word, "we." Someone may have it, but not, "we." There are too many LLM's, pandora's box has been opened. That being said, it is possible, just as companies have implemented software that accounts for sales tax in every single jurisdiction of every single town in the United States, you can build a mixture of expert software which runs a given set of tokens through 10,000 different LLM signatures and then filters down a response based upon the rating of the signature for each LLM silo. However 1.) That's really expensive to build. 2) Really expensive to run. 3) Would be highly custom/privatized, because who needs that? Google may have their own for SEO purposes that approximates the above, but that's going to be an internal tool and you would have to sign NDA's about it, they would not disclose the nature of that software.

@MarkIngraham didn't expect you to buy NO on this

@firstuserhere ai isn't important enough to develop solutions

@DuSusisu the market is about a software which can detect AI generated text from human text. Do you expect such a software to be reliable, by the end of the year?

@firstuserhere it won't exist

@DuSusisu it already exists. Just not good enough

Comment hidden

More related questions