I've always felt this was the case in my own mind. Language is the serialization format for abstract concepts.
This is why I'm very interested in constructed languages. I think it might help human cognition if we had a more efficient serialization format for internal concept transport.