389 karma · joined January 30, 2025
On the other hand having 90t/s with any local model is nice and Pi with loop police extension can prevent looping a lot.
Curious: Anybody have comparison what is the difference when company is changing to token based billing? How many times it is bigger than 200$ subscription?
Do you have this DRY docs?
Maybe both is happening a lot of choices will make more people go with Chinese models, which means less money to the US which means more problem to US companies. But at the same time they are cheaper and less of quality because this is China, this is what they does.
Personally I think this much more complicated as everything in life.
Unless somebody will find a way to actually do training by just updating weights with new data you have to train from scratch and this is very costly process.
Saying that some lab is profitable because they are profitable doing inference while disregarding training cost is not fair assessment.