You'll be fine.
However, you're ability to conceptualize, use, alter, convert, code, write modules, etc won't be effected as long as you put in the necessary effort.
If you want to program, you don't need to know much in the way of mathematics. If you want to program well, knowing advanced math will open up new possibilities for problem solving. If you want a CS degree, start taking math courses now.