I really want this (in OpenAI API). Does google not care about the reputation it's getting with this shit:
> We'll be launching context caching soon, along with technical documentation and SDK support.
it's not live and god knows when it will be
> We'll be launching context caching soon, along with technical documentation and SDK support.
it's not live and god knows when it will be
Throwing the hat in the ring forces your competitors think about it and make them work too. It also gives you first mover advantage making people think you did it first.
A lot of AI tools make more sense for their enterprise customers rather than people like us. People like us are good only for hype and not making money.