Yeah, but they are also doing an insane amount of inference and continuously experimenting with developing new sota models.

Yeah, certainly within an order of magnitude of that number.