I feel you've highlighted the core of the issue without understanding it. With diverse populations people place value on different things. You are obviously not an automotive enthusiast. There are lots who are.
I'm assuming that the location was originally chosen because it was out of the way or the area it was held in was deemed acceptable at the time. You could just outlaw it and then what happens? People will still meet up illegally. City planners have a difficult job. They need to find acceptable locations for disruptive activities.
Getting along doesn't happen by accident it takes city officials, car club members, and new and old members of the community to create a city everyone can enjoy. Easier said than done.