Hacker News Reader

If they don't know how to call an API, they won't know how to run local models (at the moment it's quite a pain to set-up all the dependencies)

It's actually not bad, the hard part is getting the hardware. Kobold will install itself most of the time with a double click.

Then an "average" person is certainly not someone who is able to download and run an LLM on their device.

"AI" as we know it is hardly 6 months old now, just wait a while and it'll be grandma accessible.

You exaggerate a bit! Machine learning and language models have been around for decades. OpenAI itself has been around since 2015.