"Ask first" works just fine when the question is "can I stick my hand down your pants?". It really isn't the social norm to do that without asking.
I can wrap my head around someone thinking a quick kiss in an informal setting without explicit permission could be brushed off, but sticking a hand down the pants of even one's significant other in a public context is way beyond any social norm I'm aware of except perhaps at an orgy.