By "hallucinate random nonsense" I mean the thing where language models will occasionally just say totally ridiculous out of left field stuff, or blatantly be wrong about the current conversational context (e.g. tell you you said a thing you very definitely did not say).

Resolves YES if my subjective impression is that language models basically don't do this anymore, or if we end up getting a reasonable benchmark for this and very good performance on that benchmark.