"Backyard" is obviously not to be taken literally. Anywhere you put one of these things is going to have an impact on the region. But perhaps you can provide some examples of places that are not in anyone's backyard?
"in [someone's] backyard" is a colloquialism that refers to "those who are in that area"