There really is a "peak comfort" or "good enough" for most people, the metrics of cost and convenience can trump objective quality and performance.
Moving the amount of people we want to move, for the cost at which people are willing to endure, shook out the way it did and supersonic lost out.
For general aviation you just have many more challenges to overcome than say driving. It takes really special circumstances before it makes sense.
We won't have flying cars for the same reason we don't all have planes. They aren't required, few need them and they would be more inconvenient to operate than a simple car.