Apple is most definitely working on running them on iPhones.

I mean, for the training part. Inference is easy (relative to training). Even my 3 year old camera can do real-time eye/face-tracking for humans and mammals via a real-time neural network running on a dedicated low power DSP.

The consumer hardware is made by the same company and there's little competition. Rather than undercut the price of commercial hardware, what commercial applications for GPUs has done is raise the price floor of consumer GPUs. The companies are not undercutting themselves. It's profit city.

Generally it's thought in the hourly cost, plus how much productivity it adds to your workflow.

IOW, you pay yearly price of an engineer, plus some hourly cost, but it generally adds more productivity rather than optimizing what you have at hand.

> H100 is worth 1 year of salary of mid engineer in eastern eu

If you can have them supplied to you, in the first place.