There’s a running joke in my circle about the “dad professional class”. People who are older (40-60s) and go to the office in a remote-work-accepting world mostly because they seem to want to leave their family at home. They all dress like shit in ill-fitting clothes, but because they’re older than the “office casual” dress code, they tend to dress in overly professional button downs and slacks. The business attire that look out of place in tech next to a 25yo in a tee shirt. They don’t seem to know people don’t always take them seriously, and think “they’re not here to [change the world/be the best/rise in the ranks/etc], they’re here to avoid their wife and collect a salary”.
TLDR: stop telling people you try to avoid your family, and start tailoring your clothes, it’s honestly not expensive.