It’s pretty difficult because my manager is very incompetent and micro manages everything, he has called my personal phone after hours many times asking about things
If "yes", then blacklist his number and never answer after hours. When asked to do something different always explain how that affects the other work in progress. Only work 8 hours or whatever you are contracted to do. If your manager kicks up a fuss, then go to the next level and/or HR. Refuse to be demeaned. Of course, you could get fired, but then your manager might get fired for his incompetence. It is a risk. But taking the "I don't give a F**! FAFO" attitude makes you feel more in control.
I speak from experience. I once had a managing director give me a hard time, I blew up on him and waited for what I thought was the inevitable termination. A week later, and most unexpectedly the firm's partners fired the MD.
People can only take advantage of you if you let them. Why are you answering his calls after hours? By answering his calls you’re signaling to him that it’s okay.