Hacker News Reader

I have a system prompt of around 100k which includes a couple of internal schema definitions. Having this cached could be super useful to us.

100k … I hear and use all of these high token context LLMs, but often they fail to include all information that should be in their context.

Does your approach work for you?

Would love if you could de identify and share a bit more detail on a prompt that big.