What if the workplace is not the problem, but me instead? I don't want to quit, it could be worse somewhere else and for me it could be bad everywhere.
That's a valid concern. Unfortunately it's one of those things that only _you_ can find the answer to. Getting experience in different companies helps here because you have something to compare your experiences with. Ask yourself what problems you're facing. Write it down; it really helps.
If you are the problem you are also the answer.