Having chatted with friends who have gotten stuck in elevators, you definitely should care about total travel time.

In one case, the building was still being commissioned and it took a while for anyone to even realize they were stuck (could spawn a whole discussion about launch processes in itself).