Will an LLM be able to match the ground truth >85% of the time when performing PII detection by 2024 end?
Plus
25
Ṁ4723Dec 31
84%
chance
1D
1W
1M
ALL
PII - personal identification information
Stuff like people's names, numbers and codes that identify stuff (SSN, phone number, passport etc), places, locations, names of orgs, attributes that can be used to identify a person, etc.
GPT-4 outperforms Presidio, Microsoft's custom built tool for PII detection. GPT-4 matches ground truth ~77.4% of the times, while it misses a single PII element ~13% of the time.
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Sort by:
@PatrickDelaney I think microsoft tested against their in house system, which does detect PII on real data
Related questions
Related questions
Will a LLM-based AI be used for a law enforcement decision before 2025?
50% chance
Will openAI have the most accurate LLM across most benchmarks by EOY 2024?
37% chance
Will the Jan 2024 version of the LLM detector "Binoculars" be effective against OpenAI's best model at end 2024?
59% chance
Will a LLM beat human experts on GPQA by Jan 1, 2025?
87% chance
Will any LLM outrank GPT-4 by 150 Elo in LMSYS chatbot arena before 2025?
20% chance
Will there be a gpt-4 quality LLM with distributed inference by the end of 2024?
27% chance
Will we see improvements in the TruthfulQA LLM benchmark in 2024?
74% chance
Who will be ahead in the AI/LLM war by the end of 2024?
Will the best LLM in 2024 have <1 trillion parameters?
30% chance
LLM Hallucination: Will an LLM score >90% on SimpleQA before 2026?
55% chance