I feel the same way. I always think in language and can't conceive of thinking productively another way. Sure, I can imagine a shape, but that's not something that I'd consider really thinking.
Additionally, for me to really understand some concept, I often have to concretely put it into language so I end up talking to myself. I got a cat so I feel like less of a crazy person - I talk to him and not myself.