I have been very unimpressed by ChatGPT. The only production application I'm considering using it in is correcting grammar of a passage; anything more complicated than that it can get wildly wrong.
I do sometimes use it to figure out the name of a certain concept; it sometimes works for that when Google has failed. But I always have to double-check the term it gives me on Google to ensure it's a real term and it hasn't just hallucinated something.
This market resolves YES if I find GPT-4 to be useful for a task that I didn't find GPT-3 or ChatGPT useful for.
(If I find GPT-4 useful for a task, but then realize that GPT-3 could have done it perfectly well and I just hadn't thought to try it, that's still a NO.)
Try using ChatGPT to debug your code. Paste in:
High-level project description
A list of important function signatures, classes with method signatures, brief descriptions of each.
A failing unit test
And ask it to walk you through debugging the test. It works better if the problem is compute/data structure based, than if it's a system problem.
It's not as good as an alert human with experience in a codebase, but it can compete with me when I'm tired or not used to a language or haven't been in a codebase for a couple weeks.
I have entire 1000-line projects I've written where I've not looked at any of the code deeply, and haven't used the language before. But I just keep organized notes and have ChatGPT3 write it function-by-function, and now ChatGPT4 can debug code(and is a bit better at writing too).
@Mira I don't want to give OpenAI money, so I don't have access to GPT-4 yet. Gonna wait until they make it free to test.
@IsaacKing If you want me to relay prompts for you, ask on Discord.
@Mira Do you pay per prompt or is it a flat subscription?
@IsaacKing $20 flat per month for ChatGPT4. There's a limit of 100 messages per 4 hours for GPT-4, but I don't use all of them. I already paid, so it costs nothing extra except my time.
The API is per-prompt, but I haven't gotten access to GPT-4 for it yet.
@IsaacKing "I don't want to give OpenAI money" Is this for ethical reasons?
@IsaacKing What's your issue with them?