Put them under psychiatric evaluation, e.g. in a ward. Someone who is in a hospital is not able to harass people on the streets.

But for that, you'd need a functioning healthcare system.