And that goes for authorities too. Had a non-Swedish partner for a few years who always communicated in English in all interactions with Sweden's governmental services - no problem. All important government websites are available in English. Knowing Swedish isn't even a requirement for citizenship.
So while knowing Swedish is certainly very beneficial and recommended, you can certainly get by without it, and work for many interesting companies (at least as a developer).