I used to think that, but I've found there's way more to gain with Ctrl and using ctrl+[ instead of escape (or imap jj <Esc>)