At least that I can understand. It has implications on right of way, usage, easements, property values, etc. without even getting into issues of adverse possession (which combined with property value issues can become real trouble).
The line between "please don't point your camera onto my property" - something I would respect as a courtesy regardless of the law - and "I'm going to cross the street not to interact with this person" goes straight through mental illness in my opinion. Normal, stable people do not behave that way.