I wear shirt sleeve button up oxfords to work all the time. I have never heard anyone say anything about them.

Yeah so they found if the boss wears short sleeves (reliably experiment John T Molloy, in Dress for Success which is like the biblical source on such matters, true social scientist) his employees slack off. He didn't investigate the causes, but it's a very marked difference.

Now, shorts are allowed even in funerals in the Caribbean, there's this special suit with jacket n shorts, long socks, because the heat is unbearable even the political monarchs wear that suit, like that suit is checkmate.