Hacker News Reader

Do you send that wall of text on every request? Doesn’t that eat a ton of tokens?

System prompt.

System prompt is not free, it's priced like a chat message.

OpenAI's ChatGPT "custom instructions" do not add to your token count AFAIK. They ARE limited in size, though.

Does it get sent every round trip?

If you've built a thread in OpenAI everything is sent each time

I get “memory updated”. It seems like it has some backend DB of sorts.

Memory is the personalization feature that learns about you.

Ah cool