At least where I come from I do not feel that in the slightest.
http://time.com/transgender-men-sexism/
'Most trans men I spoke to also identified another commonality: Once they transitioned [from female to male], walking became easier, but talking became harder. To be more specific: walking home after dark felt easier, casually talking to babies, strangers and friends felt harder.
“I have to be very careful to not be staring at kids,” says Gardner. “I can look at a mom and her baby, but I can’t look for too long. I miss being seen as not a threat.” Ditto for kids on the playground and puppies, multiple guys said.'