I guess it depends on what that means. I'm for all services being in English at a minimum, that makes sense. I'm really not for removing obligations to translate or interpret.
Non-english speaking US citizens exist and interact with the government. For example, someone that's deaf. Or for reading, someone that's blind. Having access in those cases is important.
But further, there's a humanity aspect as well. Any asylum seeker can get railroaded. Or heck, a visitor from another country. If these people are accused of crimes they should have the right to understand why the government is punishing them if for no other reason than to give their side of the story.
Treat others as they would like to be treated.