As a general rule, I am not in favor of terminating someone's employment because they made a bad call. You can't expect people to take risks & try bold things when their failure means unemployment. People need to be able to learn from their mistakes.
This is a branch of the government and law enforcements, whose responsibilities, powers and limitations are codified in writing. This is not a scrappy little startup - there are edicts in place about how to do things, not to "be bold" when you have such power behind you.
Say an Islamaphobic Congress passes a law that bans wearing turbans, and that becomes extremely popular. A bold for someone in the executive branch could be actively defying that law, challenging it in the court system. Someone has to fight the good fight, and I hope government has people like this.
At the end of the day, it's hard to imagine how governments or for that matter businesses could operate if employees were immune to being fired for their job performance. There would be little motivation for actual work and little penalty for taking outsized risks. Seems hopelessly naive.
Of course this might make fighting the good fight harder sometimes, but that's how it is. If doing the right thing were always easy, everyone would do it.