Quick tip for people who want to experiment with local models: A lot of the common smaller models are also available on openrouter or other services. Dirt cheap.

I know it's not the same. But a lot of people buy expensive GPUs, just to find out they have no real use for smaller models.