It didn't matter. Girls would stare when I walk around. That's never happened to me before lifting. Of course that boosts my confidence which exudes even more confidence.
You know the joke where people teach you how to be attractive and the first thing you need is "be handsome"? It's similar to lifting weights. You only get the confidence after people find you attractive.