I’m an AI enthusiast, and it’s not clear to me that selling inference to a prop model is a winning business model, which is what Anthropic and OpenAI are doing. The open models are good enough today for many things, and are likely to only get better. Feels like inference is a commodity, and not clear how much money there is in it.
I would love to know how much of the inference I pay for is being paid for by VC cash: I suspect a lot of it.