Can you elaborate on “no way back”?
The weird thing is it seems to get noticeably worse or better depending on how much time I spend outside
[1] https://health.clevelandclinic.org/do-glasses-make-your-eyes...
Don't trust everything your doctor says verbatim, they often oversimplify and their information can be out of date. Give your doctor the benefit of the doubt but check it against other sources and use it to build a mental model.