I asked a few of my friends that are ML engineers this question and all of them said to run the LLMs in the cloud with their infrastructure because it was going to be way faster.
If you just want to tinker around I would look at @JSR_FDD's comment.
I can’t help but draw parallels here.
We don't have that anymore. Specs have more or less stabilised and what you're buying now could easily last you years.
On that note though, most car salesman are somewhat stupid, although the best ones are atleast normal. (I was a cal mechE grad and top 0.2% nationwide car salesman). They also slowly brainwash themselves into believing most of what they say.