You're frustrated because you're the sole reason why it's happening. Set boundaries and you should be fine. Walk out of the job on time, and get a new phone number and a phone with a dual sim.