All of this to say I have been writing software professionally since 2006, and while I do struggle with the thinking behind functional programming and math-heavy subjects like graphics programming, I have written lots of business software that has brought me personal satisfaction. I would really like to understand calculus better, but I'm not sure if it would actually do anything for my skills in programming. If math is holding you back, think about whether you need the full breadth of CS knowledge, or if you just enjoy writing software.
I became better at code organization, making code maintainable and simple enough to understand unless performance was an issue, and general people skills. I can understand why math and software are so close to each other, but at the same time, I don't think it needs to hold you back unless you really want to go into a topic that is deeply intertwined with math. It took me four times to get past pre-Calculus, and once I did, I realized that I just did not enjoy that type of math and didn't need it to build useful software (as in makes people's lives easier and/or generates profit for business) that I also find fun to create.