An unelected group of bureaucrats should not have the power to enforce their own beliefs. It should come from congress because citizens elected them. The bureaucrats were never elected.
Your argument falls apart because the entire point is that we elect representatives. Those representatives can not do _everything_ themselves.
Even the most basic city government has elected and appointed positions.
Do you elect every single cabinet member into office? How about all the people that work in those offices?