Not the only way. You can do what Bill Gates did, and buy all the surrounding properties. In his case, some of his staff live there.
Billionaires do this - Zuckerberg did the same.
I don't have that kind of money!
Yup: After my a-hole neighbor yelled at me because he thought I was mowing his lawn, I got the property line surveyed and had him remove all the shrubs he planted on my land.