"They let you do it" is not consent, it's the absence of fighting back. A woman does not have to physically fight her attacker for it to be assault. Consider the phrasing "they let you do it if you hold a gun to their head".
For you it's sexual assault because you imagine him attacking women without any warning while I on the other hand have no reason to believe that he isn't escalating sexually in a normal way, leaving room for women to say no or move a step back to signal a no.
Edit: When I think about it then I must be a sexual predator according to your definition. I cannot remember to have ever explicitly asked a women if I may kiss her.
edit: and yes you probably are then. glad you admitted it. please turn yourself in.