If you want to live in a mansion and can afford it I say "All the power to you!" But all the rest of us will be happy to live in an affordable place where we can get a slice of pizza and a cold beer without driving 20 minutes. Also, I know I want to see that homeless person begging for food living in an affordable community that has plenty of extra economic power to provide all the Panda Express he can eat!
You are not a bad person for wanting to live in a mansion or even just a bungalow far away from the city center. That's honestly pretty great! In fact, it's my hope that building walkable, affordable communities will make it even easier for you to afford and live in such a place.