How much conclusive evidence people need to stop parroting that inference is expensive? Literally this article is another example showing it's cheap and just got massively cheaper.
Relative to traditional software margins, the type of margins we are all used to, inference is obscene.