Do you even understand what you're suggesting? Do you understand how the data flow would look like without a kv cache?
We may spend a decade making persistent token-level KV state cheaper, before recognizing that much of what we call “context” should actually be transient, compressed, reconstructed, or represented in an entirely different state space.
KV cache risks turning an optimization of today's representation of history into tomorrow's semantics of memory.