Honestly. Can't really think of when I use escape to give a real answer. I think I could hit it without looking, but I don't think I hit escape that often. Or maybe I use it all the time and won't notice until it's gone.
But yeah. If ^[ or caps lock mapping is not an option, and your workflow requires a lot of escape presses, it could be annoying to have to look down to hit it.