A const prompt across all of Anthropic's subscribers could draw from a global cache rather than per-user?
Although saying that out loud makes me question it - each per-user chat and growing cache would need eventually to own its own ~contiguous memory block.