No one here gets it, even though @sama has said it countless times.
I will write it explicitly for you once again:
The plan is to make inference so cheap it's negligible.
I will write it explicitly for you once again:
The plan is to make inference so cheap it's negligible.
No one thinks about the cost of a db query any more, but I'm sure people did back in the day (well, I suppose with cloud stuff, now people do need to think about it again haha)