2: Voice your opinion directly to your supervisor in a respectful manner, and ask for follow-up.
3: Wait for follow up and track any changes made to processes or whatever.
4: Give a reasonable amount of time.
5: Then leave.
If you skip to 5, you're not really trying to fix the problem. You're just jumping ship - that's not a solution, really. Being an adult professional in the workplace requires you to confront problems directly.
This is not about compensation.
Leaving for compensation is absolutely a valid reason. Again, though, the same rules apply. Express to your employer you have received a job offer at X% more, with X improved benefits, and would gladly stay for a match. The worst they can say is no, correct?
Either way, the original conversation was about issues with the employer/manager. Not necessarily compensation.
That only makes sense if you don't like your job and your new job is better. People who leave are quickly forgotten.
Otherwise, if you like your job, it's in your best interests to figure out how to fix it.