It's only trivial if you either genuinely don't care about what you wear or actually like selecting clothes. If you do care about what you wear but don't like selecting clothes, I can see why it would annoy you.
I feel the same way about washing dishes. I care about having clean dishes but I really don't like washing dishes. Even now with a dishwasher, I get annoyed having to hand-wash the dishes that aren't dishwasher-safe.