Yes. The bad guys aren’t going to sit around and wait for you to rack a round and flip a safety. Guns should be designed to be safe with a round chambered and no manual safety. This is why Glock is so popular.
I realize single-action is generally very safe, but this is the exact reason I fell in love with the P99 AS action (striker-fired SA/DA with a decocker).