The idea of not working for "the man" is merely an illusion. If you are freelance or a business owner, "the man" is your clients/customers and the government. Let's say your enterprise involves the illegal distribution of contraband, then "the man" is your supplier. Or let's say you're just a laborer working for a small building contractor, the boss is "the man".