The Concorde had a lot of issues with getting permits to fly overland due to sonic booms disturbing residential areas, so was limited to flight paths primarily over the ocean...which hurt the usability of the plane a lot. Add in fuel inefficiency (not sure if this is still the case given progress in aerospace engineering?).
Maybe aerospace engineering experts can weigh in on the fuel inefficiency issues, but definitely the combination of cost + limited flight paths made supersonic commercial flights nonviable from a business perspective