There's also the 2x spark way, which should be ~8k eur? Someone down the thread reported ~60tps for 2x sparks. That's totally usable for local inference.
You can also do 2x 6kPRO in a workstation, for ~20k.
You can also do 2x 6kPRO in a workstation, for ~20k.
The 4 bit quant technically fits (there's a 127 GB version) but ... obviously that's not going to work. It is so close though, surely someone will a way to do it.
But still, even for mid level projects API is orders of magnitude cheaper, since you don't need to set it up and maintain it.