It's always a complicated issue. Depending on the city/region, tourists can be the life blood. More than a few places that I've visited you're a welcome addition to the local ecosystem, bringing much needed revenue.
There is always a healthy layer of NIMBY, I want to be a tourist but I don't want tourists to come where I live.
Sure, they should be regulated, and in many places in Europe they are regulated.
Any business/housing has the potential to be bad for neighbours, which is why we have zoning and planning laws. Bars and nightclubs, industrial businesses, apartment buildings. Short term rentals are no different, rules and taxes should apply. Fines should be imposed for rowdy party behaviour (which is one of the more negative aspects of short-term rentals).