Actually, in Signal more recently now you don't even get to confirm the new key, it just says "hey, the key changed" in the conversation text and keeps going.
I'm not exactly comfortable with this now - it seems like someone may be able to spam messages to hide the key change.