It’s been a long year helping non-programmers figure out why their GPT output doesn’t work, when it would have been simpler for all involved to just ask me to write what they need in the first place.
Not to mention the insult of asking a robot to do my job and then asking me to clean up the robots’ sloppy job.
Then ... I realized I had picked 3.5 by mistake, so I went back and copied and pasted the same prompt into GPT4 and it failed horribly, hallucinating functions that don't exist in that API.
I did a few other tests and yes, GPT 3.5 tends to be better at coding (less mistakes / hallucinations). Actually, all the 3.5 code was flawless, whereas all the 4 had major problems, as if it was reasoning incorrectly.
GPT4 was incredibly better when it first came out, and I was gaslighted by many articles / blog posts that claim that the degraded performance is in our imagination.
Fortunately, 3.5 still has a bit of that magic.