Related to your question, the episode also explores the history of "duck and cover." It turns out it's there is some credibility to the technique. In September 1945, the US sent a team called the Atomic Bomb Casualty Commission to Japan to research and interview survivors of nuclear blasts. They located survivors just a few blocks from the explosion epicenter, who had been sheltered by concrete basements. They also heard stories of people who were killed just by shattering windows and falling debris. With just some ability to shelter, survivability might be higher than you suspect.
Thank you for the podcast reference.
"Its explosion created panic among local residents, and about 1,500 people were injured seriously enough to seek medical treatment. All of the injuries were due to indirect effects rather than the meteor itself, mainly from broken glass from windows that were blown in when the shock wave arrived, minutes after the superbolide's flash."
Many of the injured went to a window to see the spectacle in the sky, not realizing that the shock wave was about to shatter the window in their face.
Same thing happened in the Halifax explosion.
"A fourth-grade teacher in Chelyabinsk, Yulia Karbysheva, was hailed as a hero after saving 44 children from imploding window glass cuts. Despite not knowing the origin of the intense flash of light, Karbysheva thought it prudent to take precautionary measures by ordering her students to stay away from the room's windows and to perform a duck and cover maneuver and then to leave a building. Karbysheva, who remained standing, was seriously lacerated when the blast arrived and window glass severed a tendon in one of her arms and left thigh; none of her students, whom she ordered to hide under their desks, suffered cuts."
It would still be a logistical nightmare, but other things being equal should proceed in a more orderly fashion than a hurricane evacuation, especially since the exact time of impact would be known in advance.