Why are you referring to being a manger as a privilege? It's not a master / slave relationship you know?
Getting used to being a manager (or the 'privilege' as you call it) is not a bad thing and in no way does your interpretation of human nature make any difference.