As someone in a similar journey, I say: No, the knowledge won't stick.

OTOH, the output might stick?

Then the question becomes do you value knowledge for its own sake or for what it enables you to do? I don't have an answer.

I’ve never been a cram for the test kind of person. I do best when using knowledge in an ongoing basis. Regardless of AI, things I studied intensely a decade ago but never use are by and large gone, whereas things I use frequently stay and deepen.

I don’t expect it to be any different with AI, but YMMV.