The colloquial meaning of the term is not, "guy who plies women with alcohol until they can't say no." It is, "a successful person, typically one who has a lavish or self-indulgent lifestyle." Your definition is completely made up. Or are these synonyms to you?

Virtually nobody who uses the term "baller" in its douchey sense, ironic or not, is implying "sexual coercion". Is Aziz Ansari bragging about being a date rapist every time he uses the term? Obviously, he is not. I don't know why you're trying to defend this obviously hyperbolic argument.