I don’t know much about the ins and outs of LLMs, but if something can be reversed engineered that quickly. What exactly is the large moat that makes them worth 1trillion?
21 karma · joined April 18, 2018
What’s the cost to run this stuff locally, what type of hardware is required. When you say virtually nothing, do you mean that’s because you already have a 2k laptop or gpu?
Again I am only asking because I don’t know. Would these local models run OK on my 2016 Mac Pro intel or do I need to upgrade to the latest M4 chip with 32GB memory for it to work correctly?