Actually, the problem is not so black&white.
For example, in Italy there isn't freedom of panorama. What this means _is not_ that you can't take pictures of St. Peter, it means you need an authorization if you want to sell products based on the image.
Whether this makes sense or not is arguable, but it's not the "right to photograph public places" which is missing.