Hacker News Reader

I don't know if this is still the case, but there was a point where they were trucating and summarizing system prompts. For instance, you could ask the chat session what the current system prompt was, and it would respond with something somewhat similar to yours but much more general and vague.

Recently gpt-4-turbo started rejecting writing some tests because it 'knows' it would exceed the max context. (This frustrated me deeply -- It would not have exceeded the context)

Can't we all just go test the responses with old chats?

I've tested old chats with the latest 4 and 4o models, and what had been zero-shot now sometimes can't even be done (or at least not without carefully guiding it to the answer).

My old chats say they have been migrated to 4o. But, I swear (can't confirm) that they perform better than a new 4o session. I haven't had time yet, but I wanted to side-by-side compare the responses from those old chats with the current 4o model.