The issue with having your address known isn't a random person showing up to your door, because the chances of any of them actually coming to your place is very low. The issue is having the police showing up at your door with guns blazing. This has become a huge issue for live streamers and youtubers and has led to deaths.