You can keep around the KV cache from previous generations which lowers the cost of prompts significantly.