It's deliberately so and used as an in group marker.
There are also complex unwritten rules governing dress, speech and general manors that serve the same purpose.
There are some job interviews you better not turn up to wearing the wrong colour shoes or shirt.
Personally, I blame the Normans.