Math is a language. It is the language of science. Even in the life sciences you need to understand sampling statistics and p-values. Chemistry involves reaction rates and exponentials.
Learning any language is hard. But without the ability to read, understand, and use language you limit yourself.