If it's only for the rich then the prices will be high. Meaning the capitalist mechanism of resource distribution will be even higher (more paid by the rich received as income by the non-rich). It will also take demand from existing airlines making fares lighter for everyone else. It also employs people. It also drives technology forward. And ultimately it does let people travel in less time, and why wouldn't we want that? To some extent emissions are not as bad as you'd think since they are being emitted over less time in the course of a shorter journey. Success in this category will also drive competition in every metric and work to bring cleaner, shorter flights to everyone over time.
There is a lot to love about the idea of supersonic flight.