I don’t have a problem with it. This prevents a private entity from monopolizing a possibly world-changing invention. The government can auction licenses to create competition, or even give it away for free.
I would assume or at like to believe this is true with federal government patents, but it's not true for state governments, government-funded universities, etc. It would be nice to have a law or official policy to point to that states outright that the federal government can't or won't sue anyone for using the technology in those patents (or the opposite).