If you're not interested in learning these areas, it's also safe to say you aren't really interested in deep learning either. Which is not to say if you don't already know these areas you aren't interested in deep learning, but if you don't know them and are interested in deep learning you're likely already studying them.
I say this because deep learning and the vast majority of ML really just boil down to an application of these basic tools. Deep learning/ML without the linear algebra, probability theory, calculus and coding isn't really anything at all.