I'd say that an important part of mathematics aims at understanding structures and relations between entities in order to avoid inefficient computations. Maybe a trivial example would be multiplication algorithms that allow to bypass costly iterated sums while preserving confidence in the result.

Complexity (and entropy) have surely a crucial importance and can't be totally avoided but I think that mathematics precisely work at minimizing their impact.