Yep, this is true. To be honest, no one cares about your career but you. I'm not saying this to be harsh, it's the same for me. But no one is going to come up and say "you're really smart, and we need you to do smart person job." I wish they would, especially for me. But it doesn't seem to happen, at least not very often. Everyone gets in their own rut, and most people can only see what they think is the status quo, even if that isn't how it is in reality. And people like the status quo. It's predictable. But usually not optimized for success or efficiency.
But the only answer I have for both of us is to figure out what we want, and make a plan, and go for it. Most if not all my important growth came from quitting one job and moving into another. Figure out something that means something to you now, and go for it. You're the only one who can know what you need to do.