I’m not going to argue that it’s not perceived as creepy, because I can see that. But your second point is a little off the mark with how you phrased it. No one has a right to not be spoken to.

I ride the bus to work. There’s a very large, imposing, but otherwise friendly fellow I frequently run into. He like to strike up a conversation with/at me every time he sees me. He actually will talk to anyone who is near him. It’s annoying and unwanted, but it’s not violating any fundamental rights.

I understand where you’re coming from, but no one knows you don’t want to be spoken to until you inform them. And you certainly have a right to do that. It’s just a bit of a slippery slope wrt free speech to imply that someone’s speech infringes on a perceived right to not hear it.