I would stay in any high danger/high precision/high regulation role.
The speed at which LLM stuff is progressing is insane, what is cutting edge today wasn't available 6 months ago.
Keep up as a side hobby if you wish, I would definitely recommend that, but I just have to imagine that in 2 years a turnkey github project will get you pretty much all the way there.
Idk, that's my feeling fwiw.
I love LLMs but I'm much less confident that people and regulation will keep up with this new world in a way that benefits the very people who created the content that LLMs are built on.