To be fair, I am very involved raising my three-year-old, but I am lucky if I can tell his pajamas from his proper clothes, and as often as not fail to dress him in an outfit his mother aproves of. :)
Plus your son will probably enjoy having that piece of control.