This has the unfortunate side effect of everyone thinking there’s something “off” about you. This can have detrimental effects on your career, even if you’re a billionaire iconoclast, but a regular person probably will face greater detriment.

Notably, the cognitive difference picking between having all the same clothes and having a variety of clothes that go together in any combination (various jeans, colors of tee shirts, etc) is nil, and has the added benefit that people won’t think you’re write because you’re always wearing all black (though I can’t promise they won’t think you’re weird for other reasons).