You need to change your job. There are better places to work where your boss won't "punish" you.

Also your second argument could be applied to absolutely anything. You can always find something that deserves more attention.