I had one student who did all the coding for a successful project that we wrote a paper about. I've talked to others who feel like they are "over their head" but are working on teams with people who know how to do all the math. That might be OK because there is a lot more to successful ML projects than being an individual contributor: very few people know how to manage ML projects and if you learned something about that it could be highly valuable.
If you study for a PhD you will definitely learn the math, but you've got an entirely different problem that you could be out of the workforce between 5-10 years and the market could look entirely different then than it looks now.