Is the drop in ChatGPT’s ability to produce code real and is it related to the date being passed to the system prompt?
15
395Ṁ411
resolved Feb 14
100%29%
Real/not the date
39%
Real/the date
32%
Not real

We’ve all seen the rumors: ChatGPT is Bad Now. Some of us have experienced it.

So: is it true? And if it is, is it because the date gets passed into the prompt?

This will resolve with either:

  • documentation of a test run of 365 (or 366, we see you leap year in ‘24) prompts that shows a marked difference in output when the date is the only thing that has changed

  • Formal statement of some kind from OpenAI

  • Vibes if not many people participate (not really but I’ll cancel it if it’s <10 people in a month and we haven’t heard anything)

Get
Ṁ1,000
to start trading!

🏅 Top traders

Sort by:

this suggests it was the system prompt: https://x.com/dylan522p/status/1755086111397863777

@BruhMoment1d78 Good catch! I’m holding out for a little more conclusive proof but I find this very compelling

@PBlake142 Yeah, I wouldn't resolve on that either. It seems kinda sus, but it does update my beliefs.

© Manifold Markets, Inc.Terms + Mana-only TermsPrivacyRules