> 4 seconds to run on my Mac Studio, which cost $8,300 USD
Jesus, is it common for developers to have such expensive computers these days?
Jesus, is it common for developers to have such expensive computers these days?
Computers are really cheap now.
A PDP-8, the first really successful minicomputer (read very cheap minicomputer), was around 18,500 USD, in 1965's USD, or 170,000 USD in 2023's USD.
For a historic comparison, the price of a introductory minimal system for an actual "mainframe class computer" of the same vintage, a IBM System/360 Model 30, was 133,000 USD in 1965's USD, or around 1,225,000 USD in 2023's USD.
Those 8300 USD cited are very cheap.
A person in the bleeding edge of the private AI sector is expected to handle several Nvidia H100 80GB, each with a individual cost around 40,000 USD per unit.
Those 8300 USD cited are peanuts in comparison.
What would be x86 alternative in that price range (if any)? Xeons with HBM are more expensive IIRC
It goes really fast (same magnitude of bandwith as A100s) if your model fits in that cache entirely.
If you made a living as a plumber you would spend a lot more than that on tools and a pickup truck.