If you had full source code that fit into the context, do you think it could reliably answer questions about the code, build unit tests, generate documentation? I ask because that is the software equivalent of what you just described.
Also I'd guess that it still generally sucks at programming. Code has a lot of very similar sequences and logical patterns that can be broken, which makes it prone to hallucinating. I'd imagine that more parameters will help with this.
Are you sure you are accessing the 30k token version via ChatGPT plus?
It was not clear however that there was this token limit restriction, thanks
"GPT-4 currently has a cap of 100 messages every 4 hours"