Having a PhD in mathematics myself, I have been surrounded by such and had this discussion a few times. Some even like the ideas suggested!

I would say the most common counter argument is cultural: Classical mathematics is the norm in the field, hence one must use it to participate in research in this field.

But that seems to me a rather intellectually unsatisfying argument, if one cares about the meaning of the work.