There’s roughly a mile of roads, green spaces, and river between the airport and downtown San Jose which an absolutely identical accident would impact. It’s not very wide, but pilots aren’t going to aim for buildings if they can help it.
So while downtown being in the flight path is a risk there was some method to the madness which caused that alignment.