This might tempt me to get a graphics card and run local. What do I need minimum to run it?
As for as fast as you can read, depends on the distilled size. I have a mac mini 64 GB Ram. The 32 GB models are quite slow. 14B and lower are very very fast.
For hobbyist inference, getting a iGPU with lots of system ram is probably better than getting a dedicated Nvidia gpu.