The most dangerous, murderous things in history are powerful central governments. They are like the Ring of Power, everyone thinks they can wield it for good, but it doesn't work out that way.
The fact is that all these government agencies are preventing specific harms. Throwing them out because of some vague “big government is bad because it might turn into a tyrrany later” isn’t an argument that the harms being prevented don’t exist. It’s a non-sequitor, like saying the sky is blue when someone complains about airplane noise.
Power abhors a vacuum. I would rather that power be in the hands of the citizen votes.