I'd argue the biggest hurdle isn't even what you like or dislike, it's that when someone gets used to you being in a given position, that's all they see in you. I actually had that happen at one point in my career, kept getting an "I don't think you're ready". When I finally told them I'm leaving if it doesn't happen, they did the right thing. Afterwards I got a lot of "I'm sorry I pushed back, I couldn't see you in that role but you're killing it!"
I think sometimes management is their own worst enemy in not taking a chance on their own people.