RTX4090 is going for 2-3K on ebay. And some other commenter is saying you need 2, to run a 70B model. So that's about the same price. Though I image the GPU is faster.

https://www.ebay.com/sch/i.html?_from=R40&_nkw=RTX+4090&_sac...