I thought running something on the edge referred to running it in close network proximity to the user, rather than users having control and running things themselves.
What I find more interesting is that in the classic "close network proximity", some parts of the world may not have benefited as much from that trend since the closest nodes of a global delivery network could be several countries away.
[0] https://github.com/ggerganov/llama.cpp/discussions/205
[1] https://medium.com/sort-of-like-a-tech-diary/consumer-ai-is-...
I don't like the connotations this carries. This is almost openly talking about reaching all the way into peoples' hardware to run your software, for your benefit, on them, without their knowledge, consent or control...
What I think is important in this AI Spring is that we make it possible for people to run their own models on their own hardware too, without having to submit anything to a large, centralised model for inference.
It is kind of cyclical then is not?
By that I mean computers used to be shared and to log into it through a terminal.
Then the PC came around.
Then about 15 years ago Cloud computing became the rage (really an extension or more sophisticated system than the first time shared computers)
Now we're back to local computing. I even see more self hosting and moving away from cloud due to costs.
All that rant is to say is it's interesting.
Side note, getting this AI to be localized as much as possible I imagine will be really useful in the medical industry because it helps alleviate HIPAA requirements.
> By that I mean computers used to be shared and to log into it through a terminal.
> Then the PC came around.
> Then about 15 years ago Cloud computing became the rage (really an extension or more sophisticated system than the first time shared computers)
There's a really neat article called "The Eternal Mainframe"[1] that you might be interested. It explores this idea in greater depth.
---
1. http://www.winestockwebdesign.com/Essays/Eternal_Mainframe.h...
I wonder if the author's perspective has changed with regards to freedom to compute.
Social Media is often used as an example of privacy invasion though I've failed to see why concerns over Facebook handling your private data is worrying when they don't have a product you need to have.
Email on the other hand, is pretty much a necessity today so privacy concerns are vital there imo. Of course you can host your own server whereas you can't host your own Facebook.
Somewhat; its consistent with, e.g., Google’s “Edge TPU” designation for its client-side neural processors.
> I thought running something on the edge referred to running it in close network proximity to the user
Typically, but on the client device is the limit-case of “close network proximity to the user”, so the use is consistent.
[1] from https://www.oblomovka.com/wp/2007/08/ at least