Agreed. Feynman diagrams are a great example of this phenomenon. They might be 'pictures', but they are still mathematical notation.