Poor argument. Even if the government robbed money (which is most of the time not true), it would be better to have the money robbed by my government than by some rich dude that I never saw in my life to maintain his wealth in some foreign country.
Furthermore, you mention preferring having money robbed from you by someone in government than by some rich dude you never saw in your life. What's the difference? Since I assume your definition of theft is about actual stealing by either party, then in either case, someone you don't know is taking money you could have had access to for their personal benefit. Except that in the corporate case, the person in question is not even actually stealing from you, they're keeping more of something they first earned through sales. The corrupt government thief however literally takes from what was first taken from you by taxation.
The thing about someone else robbing my money is that companies that hide money due in taxes are effectively taking what is not theirs by law, and hiding in a foreign country where we'll never see it. If the government is misusing the money, at least some of it may be recovered, and even the most inefficient use is made inside our country, thus contributing to the local economy.