Not necessarily a dealbreaker. Concorde did ok with British airways flying out of NY. Assuming the rules don’t change there are plenty of viable routes out of Houston, NY, and SFO.
I saw it land/take off a handful of times as a kid. The noise was unlike anything else I've ever experienced - you could hear it many kilometers away and up close (on the airport boundary) you'd feel every internal cavity vibrating when it departed. As a child it was marvellous!
I do hope that the Boom team will be able to deliver a viable service for benefit us all. Would love nothing more than to travel faster.