Skip to main content
MANIFOLD
Is the drop in ChatGPT’s ability to produce code real and is it related to the date being passed to the system prompt?
15
Ṁ395Ṁ411
resolved Feb 14
100%29%
Real/not the date
39%
Real/the date
32%
Not real

We’ve all seen the rumors: ChatGPT is Bad Now. Some of us have experienced it.

So: is it true? And if it is, is it because the date gets passed into the prompt?

This will resolve with either:

  • documentation of a test run of 365 (or 366, we see you leap year in ‘24) prompts that shows a marked difference in output when the date is the only thing that has changed

  • Formal statement of some kind from OpenAI

  • Vibes if not many people participate (not really but I’ll cancel it if it’s <10 people in a month and we haven’t heard anything)

Market context
Get
Ṁ1,000
to start trading!

🏅 Top traders

#TraderTotal profit
1Ṁ18
2Ṁ12
3Ṁ7
4Ṁ5
5Ṁ1
Sort by:

this suggests it was the system prompt: https://x.com/dylan522p/status/1755086111397863777

@BruhMoment1d78 Good catch! I’m holding out for a little more conclusive proof but I find this very compelling

@PBlake142 Yeah, I wouldn't resolve on that either. It seems kinda sus, but it does update my beliefs.