Almost all of modern mathematics is not about numbers, although a lot of the objects studied can eventually be related to numbers in some way.
There may be entire categories of representational concepts which we abstract poorly, or don't abstract at all, or possibly don't perceive at all - because from our point of view the relationships are so complex and remote they're effectively invisible.