There's an assumption you're making, which is the current model of cities, ie. a dense downtown area, is the right model.
This wouldn't be the case if we optimized for the right set of constraints - all of the places you mentioned being in walking distance. If there were more restaurants in the neighborhood, I'd eat out thrice a week at the very least.