Will GPT-5 be able to solve simple substitution ciphers?
7
42
240
2025
24%
chance

GPT-4 can't do this at all.

The ciphers will be between 15-20 characters, GPT-5 must solve 5/10 of the tests to resolve YES.

Get Ṁ600 play money
Sort by:

Does the model get to use CoT or other scaffolding? Does it have access to the python interpreter like current chatgpt4?

@singer i'll use whatever simple chat window OpenAI gives to end consumers to test this

@SemioticRivalry Can you give some examples of the ciphers that you'll try?

@singer Reasonably common phrases

"always be closing"

"strive for greatness"

etc

@SemioticRivalry It can solve Caesar ciphers pretty easily if you let it run python code. Is your substitution alphabet randomized?