Gagarin flew for around 108 minutes, so orbital velocity allows longest trip between two points on Earth in about 54 minutes. Shorter trips could be less, but liftoff-landing take roughly a fixed amount of time.
Twelve trips per day is 2 hours per trip. Taking 40 minutes of flight, there are 1 hour 20 minutes to get onboard, to get off board, to handle luggage (if needed?), to refuel and check systems. Wonder how does it look from airlines operation prospective.