Startups "pivot" because they failed in some way.
Pivoting your career can be construed as having failed somewhere and needing to find something else.
In the context of a career, phrase it as evolving your skills to match market demand. The very people who "pivot" resonate with will immediately associate it with failure.