The skills and money you get in the ML career could enable you to pursue your dreams with a clear head once your debts have been settled. And maybe you could find a similar role out there?
If you are comfortable in the ML career and want to stay there, then I don't think you'll kick yourself for not leaving, as you might be happy there. You can always go once your in a more settling situation financially, and if you still have the itch, you can scratch it.