As someone who feels similarly, I'd say the difference is a tool under the control of the user, as opposed to "outsourcing" to a mix of closed-source software, opaque algorithms, and quasi-feudal corporations.
Eyeglasses, headphones, "dumb" hearing aids, all a-ok. Replacing vision or audio by a mysterious cloud product are over the line.
I'd argue that even smartphones and social networks distort the fabric of our perception, operating on dopamine feedback loops, sense-making, norms, and interpersonal relationships. These things are all deeply entangled anyway (if one goes full Luddite, but all one's friends have not, one is still captured heavily by tech in practice).
For those of who care, we have to draw whatever bright lines we can, no matter how arbitrary; for me, it's simply about having a clear line for what is private, and what is public (including anything living on cloud/FAANG, I treat as de-facto public). I want to have an intentionality with what I send over the wire, as opposed to sharing everything with the world as path-of-least-resistance.