Obviously GPT-4 is going to do better on all the major NLP benchmarks. Will it be able to do anything that previous pure LLMs (GPT-3, Gopher, PaLM, etc) couldn't?

This could be either an additional engineered modality (e.g. you can ask it to compose some music and get a sound file out), or some novel capability that I subjectively feel no previous (public) LLM had. For instance: if I can have a conversation with it about a proof I'm working on and the conversation is actually useful in a non-rubber ducking way.

Market resolves N/A if GPT-4 is not released by the close date.